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Predictable Aspects of Clerical Work * 

Roger T. Lennon 

Ueaearch and Teat Service, World Book Company 
and 

Brent Baxter 

Ohio Stale University 

The u.sunl procedure in evaluating the eflicioiicy of aptitude testa in 
the prediction of clerical work ia to correlate the test acorca with some 
measure or rating of auccess in clerical work. Few, if any, attempts, 
however, have been iimde to determine what specific aspects of clerical 
work arc Uiliited to scores on the typos of tests most coiiunotily used in 
8(;le(!ting clcriiad workers. This article de.scrihea one such attcin])t, 
carried out in (!()Uuection with the iiHual-lyj)c investigation of the validity 
of two tests used for i)rcdictinK clerical .sucees.s. The study described 
was coiuhictcd in ii large giwcriuncnt agency employing several thousand 
clerical workers. I’he plan was to have a grouj) of clerical oinployec.s 
raUid on a scries of Kpe<ii(ic staUnnents concerulug different a.spoets of 
clerical worlc, and to note on which statements ratings were related aig- 
nilicantly to ti'st scorns. 

The Teds. The te.sts involved in this study wore a.s follows: 

a. Lcarnhuj Abilitij Te,.d. Thi.s Is a lo(!al adaptation of Army Alpha, 
ICjimsiis Kevi.sioii (hy Hchrainmel and Wood); it includes .six subtests; 
arithmetic, problems, common sense, same-opposites, veanauged sen- 
tencc.s, analogies, and gencriU information, re(|uiring 27 minutos workijig 
tinu! in all. It eorn‘late.H .88 with the Otis Qtiick-iSeoring 'I'esL of Mental 
Ability-OamiiKi 'rest. ‘'Learning Ability Test” is the dosigiiatioii used 
locally, and lieu'iind'bir, to nder to this tissl- 

I). Clr.rieal Aptiiiutu Test. Thi.s i.s a test (l(W(!l()])e<l by the aiitlinrs to 
luciisnre specal and acT.iiraey in the |)erfornian(;e of simidc clerical tasks. 

* A('.liH<iwl(‘(l(;iiiciit is gmlcfully iimilc to Miss I'ivulyti Piittchin tor iiasiuLtnico in Uic 
etdli.slii'iil ('uiii|)iiliLtii)iis. 
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It ia also composed of six subtests; alphahctiziiiK, nurnlx^r oIieckiiiK, 
coding, digit counting, arithmetic computation, iukI Incutiug inf(ir[uatiuu 
from tabular data. The test requires 21 minutes of working time. Cov^ 
relations of .67 with the Civil Service Commission Clevical lOxivminiUion, 
and .65 with the Learning Ability Test have been ohLaimxh 

Both tests were administered to practically all applicanlsS for eh^ricMl 
positions in the agency at the time of employment, but virtually no 
applicants were rejected on the basis of the test rosiiltH. 

The Subjects. The employees chosen for the study included all wlu) 
had the following qualificationa; (1) had taken both test.H at the tiuu’- of 
employment; (2) had been on the job for at least three monlhs; aud 
(3) were doing fairly simple clerical work, involving no supervisovy re- 
sponsibilities. The group originally chosen for study iminbevoLl nhonl 
250, and comprised about 60% clerks of various kinds, 30% stenograplnu's, 
10% typists, and 10% miscellaneous workers such as clock cai d chex^kers 
and bookkeeping machine operators,^ 

The Check List, One of the criteria which was U80<1 to evaluate tlu^ 
testa as predictors of clerical success was a so-callcd Clerical (Jlieck last. 
This Check List consisted of a series of atatcmculs coucieriiiuij; the \vr)rk 
of clerical employees. The method used in developing the C'lu‘X'k IjisL 
followed in many ways a method originally proposed by Probst.^ The 
validity of this method aa a tcchniqxie tor monsuring Bi;cci).s9 in clerical 
work is not discussed herein, since this article deals only witli Dm 
individual items in the List, and not witli any compo.sUo rating. It i.s 
not assumed that the Btatemente in the List arc independent. The 
entire Check List appears below, together with tiie direetion.s for filling 
it out which accompanied it. It will be noted that the List inchidcs botli 
favorable and unfavorable comments on the quality and (pmutity of tlu‘ 
employee's work. The items are both specific and general; that is, Ktnne 
statements are pertinent to only a specific task, such as the tvanHcribing 
of dictation notes, while other statements pertain to chftraclcrislic.s such 
as neatness, orderliness, etc., which apply to all kinds of work. 

Check List for Clerical Employees 

pinciiom: Below ia a series of abatements which have boon innilc about 
clcriGal employees. Read each statement carefully, and <lcci(ie wlicthor or nf)t 
it IS a true efcatemont about the employee under consid ovation. Then init a 
mark m tlie margin at the left of the statement in accordance with the divi'o- 
tions below. 

atato'ment'”'^ statement i» true, put n plus sigii (-|-) beHn-o lliii 

‘For the information of those familiar with the olnssification systom in hVleral 
agencies, these subjects may be identified as crado CAP-1 2 or 'I 

*J.B.Probst,POTon«d, 1031. 8. 20-24, 
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b. If you believe the statement is not true, put a "0^^ before it. 

0- If you do not have aufTicicnt knowledge about the employee to decide 
about the fltatement, mark it with a question mark (?). 

d. If tlic statement is not pertinent to the work tlie employee is doing, 
mark it with Por example, if the statement saya something about 

typing, and the employee being conaidered doea no typinc, mark the atatement 
with 

c. Place one of the a]}ovo marka at the left of each atatement. There may 
bo some apecitil event which liaa helped you to <lGcid& about a statement or 
some special information, In tlicae cases do not hesitate to note it in the 
column under ^‘Comments/' Code for Marking Statements: True = -p; 
Not true = 0; Don't know = ?; and Not pertinent = NP. 


Mark 

here Statements 


1. Uses the correct printed forms for each operation in his work. 

2* Checks on hie work have revealed that he makes very few errors. 

3. Cun arrange tabulations and statistical memoranda in nn easily 

understood form. 

4, Mteuda systematically to mattora that require periodic attention* 

f). Keeps his records up to date. 

G. Is alert to notice the improper routing of a file or letter. 

7. Gets important letters out before the end of a day instead of holding 

them over night. 

8. Cliccks his work for errors before releasing it, 

9. Accurately transfers information to forms. 

10. Has overlooked obvious ciroTs in the work ho is handling, 

11. Does a fair share of the work in his unit. 

12. Often doe.s necD.s 9 [iry but um'equc.sted work on hia own initiative. 

13. Transmits messages correctly and intelligibly. 

M. Hus had to be corrected for the same error more than once, 

15. Has sufTicieiit knowledge of the work ho is handling to detect ob- 
vious errors. 

IG. Rarely misspells a word. 

17. Some of the stencils cut have had to be retyped. 

18. Sometimes forgets miiUers which should receive prompt attention, 

10. Sometimes gets lost in routine and forgets important details. 

20. Knows where to go for necessary information. 

21. Ls accurate in computations and calculations. 

22, Takes the easiest way when it means the results will be incomplete 

and not wholly satisfactory. 

23. Work has 8oinctiinc.s had to be assigned to others because he is slow. 

24. Can, when required, compose a letter or memorandum that covers 

all pertinent points and presentfi all necessary details. 

25. A "peak" in work to be done diacoiirngcs him to the detriment of 

Ilia work. 

20. Uesumea work promptly after an mterruptioii. 

27, Turns in letters wdiich reveal errors in lilngllali wiheh were over- 
looked. 

28, Tries to tivoirl ad ^ led responai bill ties. 

20, Docs lass work than other people in his unit doing the same kind of 

work. 

30. Correctly compiles material, 

31, Typed letters arc occasionally marred by ernsurcs or Btrikeovers. 
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...32, I 0 eager to learn more about the work of hifi unit. 
r. 33 ! His working iiifttructiona have to be repcateu frc(|iienny, 

* 34. Avoids unocceasary duplication in \m work. 

’ 35. Sometimes !aih to have adequate 6upi)iie8 and 

Kaa \\55 iA tQ do some ot his work over bcciuiKO lie has idiirlf’fj br/f^ro 
clearly understanding what is to be douo- 
37 , CoiTbon copies have sometimes shown folds, crcaKcs^ vh\ 

^38. If he ia assigned more than one job at a Uiuo, ho 1 >ihiiuiuvh ruufujuid, 
[^39. He is familiar with the relation of his work to other work in tlu! 

branch. 1 - r 

...40, Has started some new assignments without a ehnvr uinietKl find mg ni 

what is to be done. 

...4L On his own initiative he has ohtaiiicd oufcsulc traiuuig whidi IniH 
improved his effectiveness as a worker. 

...42, Calls attention to possible errors in matoriuls ludorn traiuujribiiig 

them. 

...43. Does a fair share of the moTO dilWewU within the unit. 

^v44. Checks on his work reveal that he makes no mist akoH, 

..,.46, Thespeed of no to- taking (dictation) iff us fnMfc an the work denmjjdH. 
...46, Has used poor grammar in typing Icbbors from goiiernl rlinjf.djonw. 
When he has to speed up because of a peak load, Uiuro ifi an inrnumu 
in hia percentage of erroM. 

..,48. Has made helpful suggesbiona about work handled. 

...,49> Some work has had to be returned to him to he dtjuu over beeaUKu 
of the quality of the work. 

....50, Copies of work show an uneven typing touclu 

Reviews his work for discrepancies before turuinji; it in. 

.,..62. Correctly uses the terminology of his job. 

...,53. Difficult tasks challenge rather than confuse him. 

.,..54, Raa aotaefciniea made the wrong; ivuinhev of eopicy. 

Has misdirected mail when sorting it for office {liJitribulion. 

...,66, Is often entrusted with tabulation of (liflioulfc jnatorinl«. 

....57, Quiekly leame where and how to locate people whom the HUpervh'ur 
often calls. 


-.58. Returns all loiters, records, files, etc., to tlicir proper [jhico pro/ppily. 
..59. Distracts or interuptg a dictator vmneccfisarily. 

..60, Is confused by sudden changes in assignment. 

.,61. Bothers others by asking them how to spoil words. 

..62, Typed work ig always orderly and well aligned. 

-.63. Does not turn out as much work as the other incmbera of the unit. 
-64. Grasps new rules, regulations and procedure.^ rpjickl 3 \ 

..65. Is unable fco carry on effoctWcly more than one tank at a tiiiHi. 

' employee to whom the most difUcuLt \\\\\\ 

fto Works equally well with or without clo.^D iJU per vision. 

.-88. picfcafcors have to alow up because of hia inability fcn bako dietnUnn 
last otLOugh. 

-.60. Produces work of acceptable quality even under presHure, 

.-79. Accurately ascertaina the business of visitotH aud diveelH tiiem 


.71. 

..72, 


Adapts himself easily and quickly when given a new 
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Mark 

here Stateraenta 


.73. Checks and corrects such items as names, titles, addresses, die ref- 
erences, dates, etc., before releasing correspondence. 

,74. Desk and fdes are neat and oidcrly, 

.75. Can annlyzc rccord.s (piiclcly so as to locate needed information. 

,70. Is fi'cqueiitly asked to iiialcc up special mcinonindii. 

.77. Does not id ways set up letters in accordance with regulations. 

.78. Is able to maintain the average rate of production, of the unit. 

,79. Docs not detect inconsistencies in the material typed or transcribed. 

.,80. lleruinds the .snp(3rvisor of his appointment a if lie seems to have 
overlooked tiicni, 

..81. Does not remembor frequently-used names and numbera. 

-,82. lloraiise of his slowiie.ss you sometimes hesitate to assign some jobs 
to Id in. 

-.83. Has demonstrated ability to compose acceptable letters or mem- 
oranda. 

-.84, In transcribing rlictaphonc rolls, can make reasonable interpreta- 
tions whore the roll is not clear, 

..85. Pusses on blame for own errors. 

-.89, Is aide to concentrate on dutic.'j despite the frequent interruptions 
which come with acting as receptionist. 

,.87. Tins been known to make unnecessary duplication in his work. 

..88, II is working in.struc Lions have to be repented, 

„8lh In the use of carbons with forms, the carboned material appearg in 
tlie 1 no per h])ucch. 

..90. Is inclined to sacrifice accuracy for speed. 


Clopics of tlio Clicck DisL, with directions ns shown below, were sent 
to supcrviHOiH of tlic group selected for follow-iip. 

Directions for Supervisors Mfirldug the Clicck Listn 

1. The Personnel Section is making u study of the eflcetivcncHs with which 
its aptitiifle tests predict the eniciency of its clerical personnel. In order to 
complete tliis study tlic Section is rc(pieHting that siipcrvisora mark Cheek Lists 
like tlic one atliiehed for sonic of their employoc.s^ Only those clcriijal em- 
ployees who have been tested and who liuv(5 been on the job for at least three 
months are being studied. These records will not become part of the perma- 
nent iiles nor will they affect the Civil Service efficiency rntings. 

2. It is urged that careful attention bo given to ciiceking these lists for 
otliorwise they are wortidoss. Please read and follow carefully the directions 
on tlie first iiagc (jf the Cheek List. It is suggested tluit all of the statements 
on the l/ist be read liefon^ iiny of them arc marked. About (ifteen minutes is 
required to complcle a Chcc.k List. 

3. d'lio name of the mniiloyce to be chocked is in the upper riglil hand corner 
of the List. Tin* muiie of the su])crvisor checking the I;ist nliould be ivrilten 
in tint up]>er loft-hiuid corner of the lirst ])age, Tlie number of weeks during 
which tlic work of the employee hii.s been reviewed by the supervisor in(liciite<l 
should be written bcneatli the naiiic of Lbc supervisor, 

4. It is be, Hewed tliat thmu^ is luj iietul to dismi.ss the Check lust with the 
employee unless it is .specially d(‘sired. In any case it should not bo di.scusscd 
until after the checking has Imcn done. 

5. Please return these Check Lists completed to your Bruncli Chief witliin 
four days, 




0 Roq£t T. LBiitioii o/iid Raxicr 

No supervisor was asked to complete Check Lists for move t\um L>vir 
employees and most supervisors had to mark only one. Iwcvy I'd’ort iis 
made to have the checking done by the immediate HUi)orviHor. Most of 
the reporting supervisors had about fifteen employees mulcr (hc.ir divee- 
tlon, As the Check Lists were returned, each one was reviewed to see 
that the marking had been done according to directions, and that Uu« 
proper supeiviaor had marked it. Of the Check Lists sent out, m% ^ver(‘ 
returned. The chief reasons for failure of all the Clicck Lists If) 1)P. 
returned were separations of the employees or the HUpcrvi.siun, and (ho 
transferring of employees to different supervisors. 

It is realized that highly accurate ratings were not in all cases ob- 
tained from this group of supervisors, many of whom were untrained 
in checking the performance of omployec.s. The siipcrvisor.H' clioelving 
was internally consistent, however, the correlation being o.Hlimalcd as at 
least .85. Some evidence was obtained on the agiccmcnt between HUi)er- 
visors on the total Check List score. A group of 02 eiiiployee.s were ruled 
by two supervisors, the correlation between iraias of supervisor, s' ratings 
being ,69. No evidence is available on the reliability or validity of llie 
marking of the individual items. Since those Check List rating, s leave 
much to be desired as a criterion, any findings as to the luimhor of itoins 
predicted significantly by the tests arc likely to evT on the conservative 
side. 

Results 

After the Check Lists had been filled out by the supoi'visors in accord- 
ance with the procedure described above, an analysis was underlak)'n to 
determine which of the items were significantly retated to seore.s oir tlie 
tests given at the time of employment; that is, wliich ouch couhl have 
been predicted, to some extent at least, on the basis of lest score.s. Nroui 
the total group for which Check Lists were completed, a group with 
high scores and a second group with low scores on the Learning Ability 
Test, constituting the highest and loAvest 27%, were selected. T'lic 
number of cases in each group was 58. A tabulation of re.spon.sc.s to 
each item was made for these two groups, yielding for ouch ilcin the 
number in the group for which a '<0," "NP,” or Imd been 

recorded. The results of the tabulation appear in Table 1. 

The statistical analysis in this paper deals only witli the proporlion 
of the high and low groups fox which each item was marked "-I-," 
true. The proportion conaideved was the relation of the innnber 'in the 
group having the item marked "-h" to the .sum of the and "0" 
markings. Thus allowance was mode for the rcsp(>nHe.s, rollocting 
inadequate knowledge on the part of the supervisors, and for the "NP'’ 
responses, so that the proportion for any item is bnsed only on those 
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individuals for whom the item is appropriate — e.g., typing items for 
typists, It was sometimes found that the proportion of marked 

for an item was significantly different for high and low scoring groups, 
reflecting differences in the kind of work assigned to low and high scoring 
people. Inasmuch as this study is interested in the prediction of quality 
and quantity of work rather than the kind of work, these differences will 
not be discussed licre. 

Tlie clii-sqimre test was used to evaluate the significance of the differ- 
ences between the high and low groups, and those differences for which 
P wiuj less than .10 were regarded as significant — in other words, these 
differences which were at the 10 per cent level of significance.^ In the 
calculation of Yates' correction for continuity was uniformly used 
to provide a more refined teat even when the numbers of cases wove 
sufficiently large so that it was not strictly necessary. Use of tins tech- 
nique is illustrated by the following example, which ia the calculation of 
chi-square for Item 24 for the high and low groups on the Learning 
Ability Teat. 



For x^ = -IhlS, with one degree of freedom, P equals approximately .30. 
Therefore, according to o\ir standard, this difference is not aignifleant. 

On the basis of this analysis, 12 items wore found to differentiate 
significantly betw(?en the high and the low groups on the Learning Ability 
Test. Til esc items are indicated in Table 1. 

The same procedure was folloivcd in determining which itcm.s were 
significantly related to senras on the Clerical Aplitiulc Test, High- 
scoring and low-seoring groups on Lliis test, again constituting the highest 
and lowest 27% of Uie total grtaip, wore seloeted, and biibulaliorifl of llio 
rcHponsfJH nmd(‘ for tln^se groups, Because tlicre is ii substantial oorre- 

> li] Llic uctiuil ciHnpiiUiUoii of x^ it is not TKsresHiiry to comjjLiU! the ])roi)orbi()OH jih 
B unh, since the nikiiliitioiiH lire perfoMiietl in lanm of frcciueridcse; hc[»ee these pi'opoi- 
tiuiiH are not hichukd in Table 1. 

LScc Gouldcn, C. H,, Methods of Mmlical analysis. New York: Joliii Wiley and 
8oiir, 1039, pp. 102-100, 
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liition between the Learning Ability und the Clerieiil Aplil,u<lo tosls Mie 
highest scoring groups on the two tests included nuiiiy the snriH* mli- 
vidualsp as did the lowest scoring groups. It was found that 25 itenis 
differentiated significantly between the high .seoring and Hm? low scoring 
Clerical Aptitude groups, adhering to the siune erileriou (d signilicaucc! 
as above, via., P Im than ,10. These items are imlinilcil in 'I abh? 1. 

It will be observed from Tabic 1 that of Urn !K) slulrnmnls (^oveard in 
the Chock List, 28 were found to be signilicanlly relabel (o scores on one 
or both of the tests used at the time of oniployiuont and InMiee are (o 
some extent predictable through the use of fche.sc? Lesls, Niiu* ileins ai’(» 
signifiGantly related to scores on both tests; three are ]U’(ali(‘tal)l(^ by Uui 
Learning Ability Teat but not by the Clerical Aptitude Te.st, and 
are predictable by the Clerical Aptitude l)ut not by the Lciiniing Ability 
Test. 

Discussion 

In order to see if any generalizations could be druwfi abfjut llio injure 
of predictable items, as compared to tho.se not ])ro(lictod, (ho wc'r(* 
grouped ag well as possible into several roughly h()iung<‘ue(iuH cab'goridH, 
While some items fell readily into the gi'ouping.H, many .sliilcnuudH wnv 
difficult or impossible to classify. Some seemed In lit alinust ('(pially 
well into more than'one category. An attempt liuH Ihmui made to giv<? a 
name to each group but the specific items themselves slionld la^ (‘oii.siilbal 
to understand what is implied, From a study of Lh(‘ ilonis as ihus 
arranged, the following findings wore derived: 

(1) Understanding of the work (Items 20, 33, 30, -10, 18, 01, 71, Hi, 88) : 
Of nine items in the List which dealt witli thi.s Hubjeet, oiglit wore* pr(^- 
dieted by the aptitude teats. 

(2) Errors in performance (Items 2, C, 0, 10, 13, 15, 30, <12, 11, 17, 10, 
54j 55, 69, 70, 77, 79, 90): Of nineteen items dealing with the mKuu'aey 
of the work, only three were predicted, 

(3) Quantity and speed of work (Items 11, 23, 29, 13, 57, 63, ()(i, 08, 
78, 92): All ten items in this group Were predicted except Ibmi 1 1, wliioli 
was marked ^'True^^ for practically everyone, and Item 68, wbit'U detds 
with a special skill (note-taking), 

(4) Perjormance oj nfiultiple tasks (Items 38, 05): Loth ibunn <’on- 
cerned with the ability to handle cflcctivcly move tluvu ouc/ tank and bulb 
were predicted. 

(5) Unnecessanj duplicalion in work effort (Ilonm .'M, H7): Of Uio l\v„ 
items in this group, both were predicted by tlic Gloricnl ApliUi<U‘ 'I’enl, 

(6) Typing (Items 17, 31, 37, 50, 62, 79, 89); No item dealing wuLh 
the quality of typing work was predicted. 



/■)Ti/7rf»iW*' i)f ('irrical IVorfc 


13 


(7) iS7|(hI/kiii(/ (1 Ivjus I'l, fi'.l, (i8, 72) ; No Hem \v!w predicled. 

(S) (imnwwr nud i.pfUv\ij (ItciiiH Hi, 27, ‘Id, Til): No item w;i8 pre- 
dicted. 

{!)) i^lali^lirnl vorl: (Kcinn 3, 2|, 'id, 7.'>): No item wafj prodiclcd. 

(Id) f 7)(cf,i)i>; !•/ (Kir's ini)7,- (Ui'inH K, 51, 73); No ilcin wiw predicted. 

(11) (Ili in.'i 1, .7, 3.7, oJl, 71); No ilem wan predicted. 

(12) Alhiinhr. hnnird irnri: tpiil ";;r r,'iii?i(di7j/" (rud.t (Ilein.'i 25, 25, 28, 
;)2, ()0, H.7, .SO): No ilctu wiei incdiclcrl. 

Wiiiiwiiiiry 

Iti a (‘oiiiii.'ni'.(iii tif r,’iliiij'.8 on a DD-ilcm Clicck Lint for Clerictil 
Woikcis 'villi !icini‘-i on an inlcllii'ciin! Ic.st and n clerical aptitude test, 
llic n‘snlls indicnlod !;i'\'('riil aspects of cloi'icul work wliicli arc “pre- 
dietalilc' on I lie Imi is of tlnv c Irsis, Imt pointed on tiro otlior li.and to the 
need for .M'p.aiaic in lypinn, sliortliand, slutistio.8, granimar, and 
spcllint' for ito ilioiis in wliicli (licsc aliililic.s arc required. Even Avitli 
Ilii.H moil' (Tiiiiidclo li.kt icry, it is iirolKddc Unit only a portion of the total 
variance in oii-llii’-joli pi'rfiuiiiani'c would lie predicted, for it is not 
(issniiu’d tlial liic ('lic'li l.i‘‘l covered iideiiuately nil aspects of porforin- 
aiice. As iiiik'lil l"‘ iintici|iii(< i|. Ilie aptilnde tesis did not predict any 
of (he : o-(';illeil “per.'.i'iiality fsetor.s,” Tlie Olerlcal Aptitude Tc.st was 
ellieiciil. ill iiiediciiin? i-peed, Jimoimt, and nnder.slan(IiiiK of work Lmt was 
(lelieieiit ill |ireilie(ing iircui'Hi'y. Tlds may lie duo to the nature of tiiis 
jiartieuliir (l■.'>l| wliicli is eunipo.sed of ii scries of .short siifitcsts, anti pliice.s 
a prciiiiuio on (piidc (p'osp of direct ioii.s anti rapid work. Etav evroi'.s are 
made on Ilic (I 'lt, jiiid olhcr .'Judies lidvc indicated tliut the, so cvror.s have 
little sii'nilicauec in jiredieliiuc on-the-jol) perforniance. 

Kfi'di'i'd /iirniiliif 



A Study on the Use of a Work Sample 

Marion Steel, Benjamin Ballnaky, and Hazel Lang 
7()fliJi'oaol AMtory ^ermre, Tilty 


The O'Rourke “Ringing an Electric Hell" >vnrk innong inimy 

other work samples, has been used cxiicriinculnllj' as ii dcvici! for iii oiwing 
and developing interest in various occupnllonH.' Alituil lliroo yonrs ago 
a number of Dr. O'Rourko’a work Bivmplcs w(;ro used in the. NYA Imlh 
to give ehort work experiencea in various trades and to proviiln n ituiiiHiirc 
of suitability for training in a S])ccific trade. 

The Vocational Advisory Service tentatively iuehnlisl (ho. “Uiiigiug 
an Electric Bell” work sample os part of its pHyoliohigicnl lestiiiK program 
about one year ago and set about to evaluate it at tlm Hium^ lime. '1 he 
"Ringing an. Electric Bell” work sample was cliosou Imetuisu an iiiiiMili- 
lished report stated that the time ecorca of Iho eleelricul work «!Uiipl(’S 
were found to have product-moment cocfncicnln of e.orrelaliou of nlmut 
.60 with the ratings by foremen on the work of lrnin(!e.s in timcliimidtil 
lobs such aa machine shop. Other uamplcH, such us one invelving wood- 
working, gave much lower correlations. The "Uingiug uu Mleeti ic Hell'' 
work sample took a short time to administer, wa.H clnmj) in oo.sl, ii.Hiiig 
less expendable material, and waa cosy to sot uj) for Iho next oliont,® 

A try-out of the work sample, preliminary to the aeluiil (ixiioiimmit, 
indicated that dexterities were involved in wiring ibo unit and al.so tlmi 
the experience of those working on the sample was a faoUir t(» he e.ou- 
sidered. Remarks by those taking the work sample also imliciit(id Hint 
the material waa interesting. With these ob.acrvnlions in mind, lld.s 
study waa designed to throw some liglit on the dexterities involved in tin! 
work sample, the effect of experience and the rclntivo degree of inUnc.sl 
shown in this material, in compariBon with usual testa. 

‘ BuUetia: Institute of Educational Reacarch, Tcachwn' (kdlrgn, (Inliiml)iii litiivi'r- 
Bily, and the Civics Reacnrch Institute, Washington, 1). C., Koli, 27, lOIO. KU/umi, 
Hany D.: Creating vocational interosta, Ompalma, 1012, 20, ri(l7-.'i7l. 

The work aample waa actually found to bo practicnl for linio mid coal, tlm nvorngi! 
time Uken to complete the eamplo being 13 minutos and dO seconds. 1 1 can bo Hlopticd 
at the end of 2B minutos sinca only 8% of all the Bubjecto were alill svorking at that 
time. The only expendable material was the wire and this co.st nboul 1 (I per porsiin. 

W 
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J)c'HnripUnu of iSumpling and Teats 

For (I pi‘rif)(l of hvo uumlliH tlip, '‘Ringing an Elcetvic Bel!*' work 
sample ^^'aH given lc> n rjiiMl<imly selected group of clients wJio caino to the 
Vocal ioiuil AdviKnry Servino for vocational guidance. Selection was 
limilrd oiily to tlu^ rxleiit lliat the i^crson was nt least an elementary 
Hcluiol gnuiuiito and heUveen Ihe ages of sixteen and twenty-five. This 
age grouj) reprc'HiMOs Urn hulk of the Vocational Advisory Service clientB 
who comu fr)r gniduiu’.o. dionls were also given flonio of the battery of 
tests oniiiuirily lulininiHtered in vocational guidance. 

At the end of two rnontlm, the Kanijding eonsiated of 86 individuals, 
49 males and 37 femnleH, The median age for the total group was 18 
years and 9 monlliH. Tlie median educational attainment was high 
school graduation. Isighly-four per cent cf the males and eighty per cent 
of the finoales laid completed either Homo portion of the high school course 
or wore liigli nchool graduates. 

In udniihistering Llio Work sainplo, the following materials were laid 
out before Urn Hiibject in a stuudiirdized manner; an electric bell, n push- 
button, thr(‘o feet of insulated wire, a number 0 dry cell, a penknife, a 
l)air of cutting pliiu's, a screwdriver, and a ruler. The subject was also 
provided with a sheet of instnielions giving detailed step-by-step direc- 
tiuiiH as widl as (liagrains.^ JOach subject was examined individually. 
Tim work sample was introfluccd by the examiner aa follows: "Thig is a 
job in eleetricity wo would like you to try. You do not need to have 
exptuienee with lliis Icind of jnateriah Just follow the directions on tlie 
shoel. Start right here, (Point) You liavc nil the material you need. 
Work iiH (luickly as you can and be sure to follow the directions.'* 

The tolal lime was taken, including the time spent in reading direc- 
tions. S])ced was not emiilinsizcd but the stop-watch was plainly visible 
so that tile subjeetH iniglit be aware tliut they were being timed. The 
final instruoUon was to iiress tlie pushbutton and the work was con- 
sidered complete when tlie bell rang. The work was stopped if 4t was 
still incomiilete after thirty minutes. 

Tlie regular U)i\t battery included the following dexterity testa: the 
OXlonnor Finger and Tweezer DexLcrity tests and the Minnesota Rate 
of Maiiiimlation, Placing and Turning tests. On the Finger Dexterity 
te.st, in [vccordance with the practice of the Vocational Advisory Service, 
tlu 3 total liiiH! for tlio on Live board was used as the score ratlier than the 
sc(m 3 sjKjcified by O'CJoiinor. The scoring methods of the authors of the 
tests were used for tlic oLhors. 

* iSi3G original (iiiccLioiiH and diugmiiiB by L, J. O'ltourko, Civics Ilcacfti’ch Institute, 
3500 PaLLcrHoii Street, N.W., Washii»gU)n, D. C. 
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Expcviin cn Uv I P roc o du i< * 

The cUente were divided into two Brou\)S. lu nvi>in« A (idi ly-Uirrc. 
subjects), the above-mentioned four dcxteiily (< vis wero ri' oii lidoirr llu' 
worksample and in group B (forty-three .siihjeets), I hr <«i d. i- v. on re\Trncd. 
The four dexterity tests were never given to move llion two .suhjecln nt 
one time and the work sample was tdways given imlivirlii/dly. 

The work sample was administered iiidividwjilly in ordi-r In olhiw' for 
careful observation of tlie Imndling of the tools imd me.leriiiln uml (he. 
approach to the task. The examiuers ciuefnlly rocuded Hie me of 
directions, facility in handling the tools and niiUeri.'il, iiiitinl adjiisloKuil 
to the task and the reaction to diflicullies as well ns spool mti-ous l einiirks. 
This was done in order to investigate tlm possihililies of estuhliiihing a 
qualitative rating. Each subject was inti!rvie\ve<l hrielly afler (lie lesis 
and the work sample had been ndminislered. The following questions 
were asked; 1. What have you done before that was like (his?; 2, Have, 
you done any shopwovk in school, repair work armmd (be linii.'-e, oi- a 
car?; 3. Which of these tests did you like be.Ht? Why?; ■(. l)id ,v<iu try 
harder on one than another? Which one? Wliy?; nni| 5. Which was 
the easiest for you? Why? 


Results and Interpretation 

Pearson product-moment correlations were cnlculalevl separately lu'- 
tween the scores on each dexterity test and the liine u(!ove on the work 
sample. The Minnesota Spatial Rolatione test ami (.lie U'ltourke Vocab- 
ulary test had also been given 'as part of the battery of tests and I'earsoii 
product-moment correlations were computed between caeb of Diese le.sl.s 
and time taken to do the work sample, 

The figures in Table I indicate that the corixda lions iir<> low amt dial, 
many of them are unreliable. Correlations between dexterity (est.s 
usually run somewhat higher, in the order of .40A Ftw llu; iinile.s, tin' 
correlation coefficients between the dexterity tests au<l the. work saiaide 
are very low. This might be interpreted as menniiig that the work 
sample is not measuring the same functions ns the dexterity le.sis in Ho! 
case of the males, The correlations for the ferntdes, althouglv low, arc 
higher than for the males and approach the order of . It), 'i’he dilVcrcucc.'i 
between the correlations for males and females are signilicanl, in only tlic 
case of the placing test. These results must l)tt iuterprc.lcii in I, he light 
of the relatively small samplings. 

The number of male and female cases arc too .smidl l<» make, any 
definitive statements about sex differences but tbc hoys made signilicanl ly 

Candee, B., Tlio sdeolion of dcpartiiwint stovi; piu'-kMn lUiil wriiupi'Tii 
witti t!ie ftvd <jC cettwa payd»\<>gieft\ teats, i. apjA. I'ayclioX., Itill, 25, Tti-Sri. 
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,1 nil f?//' JJ.^r nf n Samph 


Tallin 1 

n/ Wiiflv v.idi VnrIniiH Td.nl.s 


n it 


N. 

r 

IMO. r 

Hignificniicc 
of Conelftlioii 
DifTerencpa 
Ikiiwcoa jSo.xcs 


M 

\\\ 

.077 

.095 



I 


.;ni} 

.0!M) 

2.00 


Id.lli 

HI 

.150 

.072 


Twf’(‘/(-r Dexff'rily 


’W) 

,170 

Am 




:\r) 

.III) 

-OOt 

1.83 


in.di 

Ht 


.007 



M 

dO 

-,010 

.090 



V 

:ir, 

.‘lUH 

.080 

4.0 


lUilli 

HI 

,22*1 

.070 


Tiiniiiig 

M 

10 

.()'J7 

.095 



V 

115 

,017 

.101 

1.8 


Ik.Di 

SI 

.IIKJ 

.071 


Sjiati/d 

M 

'10 

.217 

.091 



}' 


.m 

.090 

1.1 


Hiilli 

SI 

.200 

.071 


Voi'filiulsry 

M 

'IK 

.220 

,002 



1' 


.317 

.100 

0.05 


li.ith 

s:i 

.201 

.07-1 



lii^luM’ hT.oiT-^ on lln^ wnrk thfui Uk; kuIh uiul thin did not occur 

on any oilirv li'sl, jifi can Im nccn from an uxanuiialioa of Table 2, The 
orilical nilio was 1 .15 for llic worlc HUinido and below 1.0 for each of the 
olhcr tn.sls ^dvcri. 

In or(l(*r lo lest the <‘n‘cet of dinerenee.s in cxporicucc between the 
inulcH and females, dala on ihe liack^roniul of each mibjcct were com- 
piled. The dat a wen* available from school record, s, as well as from work 
liLSlories and a(a*oniils r>f liob))ie.s iilreacly obtained from the individiialH 
by the (aainsclors. The rc]>lies lo the <jucfitiuiis, “What have you done 
before tlmt is like t!iis?“ and “Have yon done any sliopwork iu school, 
re])iiii' work annind llu^ lanis(^, or a car?” asked at the clo.se of tesLing^ 
al.so gave infurinal itm about ex|)enence. 

'Hie (h‘gre(! of I'XjuTiciu!!' wins raled as none, little or some. Those 
rah'd as “nniie” Imd no cxiHS'ience at all or only woodworking in elemen- 
tary Hchool. 'Idai lattcw was I la* l)asc (‘xjierieiua^ for Ibe males, “Little” 
ex])ci'i(‘nce was (IcIiikmI as occusioiuil iiiinor rci)airs at home or as a hobby, 
ii.Hnally rcbs-ivd (o as “fixing tilings”; ov two sIkj]) courses, not including 
eleclricity; or a sliort lime (approximately three mouths) experience in i\ 
factory. d1ie endtm-ia for “Home" cxjmriencc were two or more shop 
courses other tlnui woodworking; much ami more cxtcn.sive home or 
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Table 2 

MoaM. Standard Pcviftlions and Clritical 


Test 

Sex 

N. 

M. 

S.l), 

CM(. 

Fingoi Dextarlty 

U 

F 

49 

36 

H.OO 

0.03 

1.07 

0.101 


Doth 

84 

8.06 min. 

1.41 


Tweezer Dexterity 

M 

40 

0.16 

(Lfi.l 


F 

36 

(1,18 

1.11 

0.132 


Both 

84 

0,17 mill. 

(1.01 


Plaoing 

M 

49 

230.18 

21.12 


F 

36 

242.20 

20,16 

l).0H3 


Both 

M 

240. IH MT. 

20.40 


Turning 

M 

49 

m.io 

20.20 


F 

35 

m.ii 

2\,i0 

0,306 


Doth 

84 

lW.r»2ttcc. 

22.06 


Minnesota Spatial 

M 

49 

0.00 

2. IK 

0.800 

Ilektiona 

F 

36 

0.80 

I.H2 


Both 

84 

0.00 min. 

LOO 


Vocabulary 

M 

48 

05,on 

i;i,2ri 



F 

35 

08.80 

16.70 

0.700 


Both 

83 

07.14 

1L4(I 


Bell and Battery 

M 

40 

11,70 

4,60 



P 

36 

10.0*1 

6.70 

4,16 


Both 

84 

13,81 inin. 

6.02 



hobby oxpericivee; ov an elcotrical shop co\irsc nu<l nl Icnsl <iun ollicv sliop 
course; or finally three difterent shop courses, not iindnilnij^ ehMilvirity, 
Examination of Table 3 intlicatcs a conHistenb In^nd for lliosty ivilli 
more experience to complete the work sample in less tiring, Api)ar('ntly 
experience is reflected in the time scores. Blum and ( ‘lUnleu, in Uic h( udy 
referred to above, found that experience was a faefcor in laisin^^ tin* M‘oros 
on testa requiring the handling of concrete matoriuls, Hpceidcnlly tlni 
placing, turning, and finger dexterity tests. They wrolo, "AppiiKuUly 


Table 3 


Amount of Experioncej Median Time Scores i nnd InVcTqutulile lUvn^vs for 
Each Sdx on Work Sample 


Experienco Sex No. 


None M 20 

E 24 

Little M 8 

F 6 

Soma M 20 

F 6 


Mciliaii Tima 


12' 30" 

2' 20'’ 

18' 

\V 4,T' 

10' 30" 

4' {)\Y' 

17' 

;V 3H'' 

0' fiO" 

F 48'^ 

9' 16" 

38'^ 



19 


A i^tudy on the (Ittr, of a IKor/i; trample 

expcrioiUM'. in wriipiiiiif; tlocH liiivt; si effect in raising tcHt scores on 
three (lilTercnt lesf H and in reducing iuiliid differences uiiiong tlic workers 
on tlie leshs," 

To test (luanliln lively the rclntivo "interestingness" of the work 
Miiiniih!, and the other teslH, tlie rmestion "Wliicli of these tests did yo\i 
like he.HtV'’ was asked. 'J'lic ox|»eriiiujnlul grouiM had besin divided into 
CIroiip A and (Irouji Ik (Iroiij) A laid Ihe dcxteritie.s first, (boiip H tlio 
work Hamide (irat. In firoui) 20 of llie males and 11 of the females 
liked the work saiiijde lie.sl; 2 of the itiak'.sarid '1 of the fernalcs liked one 
of the dexleritii'.s host, aiul d of the male.s and 1 of the females had no 
particular piefei'c'uec. One girl of the 17 girls in the A grouj) refused to 
complete the work sample, lu (Jvon]i H 18 of the males and 12 of the 
females liked the work sainple. hc.sL, 3 of tire mules and 5 of the females 
liked one. of the dexUirilies be.st, and 1 of the females had no particular 
prefmenee. One, girl of the 19 girls in Grou|) B refused to complete the 
work samiile. For Hie total male grou]), the staiidarcl error of the differ- 
ence hel.wceii the iier cent liking the work sample beat and the per cent 
not liking tbo work sainple be.st was 7.7. This diffomice is eignificanL 
For the total feimde group, the standard error of Urn difference is 2.6. 
Tills would moan that the chancft.s are ahoiit 9 in lOOtl that the difference 
is a clianee, dilTcrenee duo to .sainpling. 


Table d 

Niiiohcr o( Anawors to (2<w.<i(loii, "Wliicli of Thoae Tento Did You Like Heat?” 


'L'asl Liked Hc.hL* 

Group A 

Group B 

Total 



M 

F 

M 

F 

1. Werk Hiunplo 

20 

11 

18 

12 

38 

23 

2. A DoxLerily Test 

2 

4 

3 

5 

5 

9 

3. No profiirenro 

4 

1 

0 

1 

4 

2 


* Olio fomulo eiioli in Groupa A iiiul 1) rofiiacd to completo the work aample. 


Anoblier qucHlion, "Which was easiest for you?" was also asked. In 
(iroup A, only 11 of tl\e iruilcs and d of tlie females said that they found 
the work sample easier^ 12 of the males and 12 of the females said that 
they found cine of tlic dexterities easier, and II of the nudes and 1 of the 
r(‘,mal(js said no one test was (Misier tluiu imolher. In Group \\ only 8 
of tlje JiialfNS 1111(1 2 of lh(i fnmiLlcs indicated tliiit th(i work sample was 
(iUHier, 10 of the males and 12 of tlie fenialos found one of the dexterities 
easi(3r uikI 3 of the males and 5 of the females said no one Icfjfc was easier. 
h]vidently the greater degree of interest in the w^ork sample was not due 
to the fact that it was easier than the oblier tests. 
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Some examples of replies to tiie qiicstifirj « lo’ " "rk Wffiid 
liked follow; "Thie ia more like real work, but tbojM! are ilu; « 
play." “Jusb liked it. Got something out of it, (In* (iouiul. 
something, know it’s finished. It works. Komelbint^ I mntle. 
more sense to it.*' 


U7lS 

MiiiU: 


Table 5 

Nuvnbcr ot Amwera to Question, "Wliirh ^Vnn Ibirun -t h*T YfiU?” 



Grouj) A 

( Snnip 

n 

Told 

Easiest Test 

M 

F 

M 

V 


1. Work Sample 

11 

4 

S 

0 

V,^ b 

2. A Dexterity Test 

12 

12 

10 

Vi 

on O.j 

a. NoitboTKind 

3 

1 

3 

r> 



Tentative CoiiclusionH 

The following conclusioiis can 1)C ilrawn from i\m prulimniavy ; 

1. The work sample had low correlations with U\o dvKtwily 
This might be interpreted to mean that the wiak huiniilo wins 
functions different from those meaHured by the Fingfu* and Tn'ee'/(‘r 
Dexterity tests and by the Placing and Turning 

2. A significant sex difference was obtained o\\ tin*, work for 

the group used in this study. Tlii« sox difforciiccj inu.st be; oein.sidi'vrd an 
preliminary and might possibly be attributed to (liffm!n('(‘H in (Irgnu: and 
kind of experiences had by the males and feinalos in f Jii-s Niunpling. 

3. The amount of experience waa related to the time Iwkm in <um\- 
plete the work sample. Those with “some" oxporionee^ eoiiiphdofl \ho 
work unit in less time than those witli ^ ^little" or 

4. The work sample was liked best by most iudividuulH Irsbid, 
male and female, although a greater percentage fenmd it more dilUi ult 
than the dexterity tests, 


Hecommendationa 

Qualitative descriptions of the performance on bln? u^ojIc wimplo g;tv(‘ 
valuable information to the vocational counseloi’H. Tint dcKcrijilionn 
were in terms of work habits and fttfcitudcfj, facility in lutmUing [In; UmU 
and material, initial adjuatment to the task and tho vuaction tn di!li- 
culties. The examiners Imd checked each other for njliabillly of lh(* 
qualitative description. Howevor, in order to make fciio woik .sumph^ 
more applicable to an industrial situation, it is thought neccHHary tu liuvo 
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tli(( (iiifililiiliv’c cliwlvi'd by quiililicd people in induntry 

(iiil.'iif'drl in Hicli Avork I'oi' inidiJicd, t.hul of electrical UHscmbly. 

'L’Ik! lime I'C.ore >in I lie win'k Hoiuple iUho iieedH validiition if the Kiiinple 
is to lie leliiled In i-iKTerS on ii job. It is proposed tluiL the Avork sample 
be tried nut in l•eYellll filinpH, niieli HS radio or (ileetrieal iissemldy, where 
sliop foreoiiin lalini'ii AYoiild lie. available, The ratiuK-s conUl then be 
(iompnreti with Die (iine i-cnre to le.st the validity of the lime soure. 

//iTd'oit bn iiiittr >>, lllp. 



A Method of Objectively Measuring Shop Performance * 

Mailou White McPherson 

County Tfaining School, ^^orl^wlJc| Afirhipiii' 

The need for aome device for the diagnosis of tminnliilil.y ntid for (lio 
refined evaluation of achievement in wood shoj) work is well kuowu. 
A survey of the literature reveals few objective inensiii'CH of perforiimneo 
in this area. In their study for the Committee on Ilitunm MiKintion 
the Minnesota group* used actual shop performance to delerndne tlio 
validity of their testa. The idea for the compilation of our U'st oriffiiiatod 
from the methods they used. It was possible that their teelmiiiuo could 
be developed into a shorty convenient evaluation and therehy inakti tlmiv 
criteria for the validity of a teat the actual perforiu(«iw, to he iiw.asuved. 
Therefore, we have begun an investigation of the priictieidity of siich a 
direct measurement and of its sensitivity to continued wood ,Hho[) experi- 
ence. Refined data regarding the reliability luid the pioumwlie vnhni of 
this device, once developed, arc matters for further losoiiixtli. 

For the copying of a model wood block to constiluLf* a Hsilinfectory 
measure of wood shop achievement, it must bo anujiuihlo U) objeelivu 
scoring and it must include aa many as po.saiblc of tlic litiHie iKdivil.iea. 
To determine these "we were assisted by ouv wood shop teiiobcne Hineo 
they were able, out of their experience, to identify the iminn lnnl- opci a- 
tioua and the preoision which our mentally defective poj)uli>lion iui}fht 
be expected to achieve. Work with at least the saw, dvill atid clusel 
should be included. The product should bo scored with .I'speot l.o 
accuracy of dimeuBlons, angles, and locations; to mctlmU of detoriniiia- 
tion of positions of operation; and to neatness of execution. In addition, 
the convenience of the device would be increased could the .sampling be 
integrated into a single piece of wood. All of these conHideratioiiH 
entered into the construction of the model 

♦From the Wayne County Training School, llobort H. IlnakuU, M.IJ., Mcdicnl 
Superintendent, Northvillo, Michigan. Studies in the Psycliopotliology of Oliildiiooil 
and Mental Daficieucy, supported by a, grant from the McGregor Fnn(i, I JcilroiL, Modii- 
gnn. Report No. 65. The nchiovoment mensuremenU deBcril) 0 (l ui tlile imiier word 
devised by A. A. Strauss, Z. P. Iloakloy, and L, C. Sullivan. 

'Paterson, D. G., and Elliott, R. M., ot a)., A/innesoln mechtinical uhilili/ tents, 
Minneapolis: The UnivfltBity of Minnesota Press, W130. 

>We vrisb to express our appreciation to Mr, iLdmund Crosby aiul Mr. Noruum 
Running. 
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In order to assure uniformity of approach the model ^as presented 
in four consecutive stages of completion. Each of the four blocks was 
10 iiichca long, inches wide, and % inch thick. The first block was 
a plain board, cut to certain dimensiona ; the second had the hole drilled 
in the loft side; the third hnci the above and also the central groove; and 
tlie fourth was the completed block. These blocks, in a left to right 
progi’osaion, were hung on the wall in front of the subject but beyond 
his reach. 

To inaure objective evaluation, a ecoring pattern was developed. 
This consisted of an outline of the model, drawn on a sheet of transparent 
plastic, tlint could be superimposed on the subject’s completed block. 
Ill addition to the outline of the pattern, lines were drawn at uniform 
intervals to indicate the dcgi’cea of deviation of the product from the 
model, Tlie appropriateness of the intervals wag determined by the 
precision which, with training, these cliildren might be expected to 
achieve. For example, lines \Ycre placed at each one-eighth inch interval 
for a reasonable distance at either side of the lines marking the correct 
length of the board. The lino marking each correct position was assigned 
a definite value whicli was reduced by one point for each unit of deviation. 
That is, a block of the correct length was scored 10; one that was one 
unit (H") cither too short or too long scored 9 ; one that deviated in either 
direction by ns much ns two units received a credit of 7, etc. 

In an attempt to determine the feasibility of measuring and scoring 
performance with tlie method outlined in the preceding paragraphs, the 
model was proJscnted to fifty-nine boys of the Wayne County Training 
School who were enrolled in the wood shop course in the academic year 
19dO-41. As enrollment in this shop is a part of the natural sequence of 
the training program for boys, there wore no known extraneous faetorB 
operative in the Bclection of aubjects. All were in their thirteenth year. 
The mean Binet P.C.® was 86.49, S.D. 6.31; the Arthur Performance P.C. 
89.93, S.D. 0.78. 

One boy at a time was admitted to an enclosure of approximately 
10 by 40 feet which had been partitioned off at the end of our wood shop. 
Here ho had access to a variety of tools including different sizes of chiaeJs, 
saws, drills and, of course, the con'ect implements for the assigned task. 
He was given a boiird of the width and thickness of the models but at 
least ori(^ yard in length and was told to make his board look first like 
the (juc lumging in front of him at the extreme left, then like the second, 
then like the third, and finally like the one at the extreme right. No 

* Ilildoii, A., Table of Ileinis persorKil cofiaiaiit values, Mirincapolia : EducationAl 
Test Bureau, 1933. 
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more specific instructions were given. He wns .allowed to work wiLhoul, 
time limit and with only caaual adult eupervision. 

One semester later fourteen of the aubjects were again pre.^(Mlted with 
the problem of reproducing the model. This wn.s done iu (trder to ineuB- 
ure the change in score which would result from nttendanco in the Wood 
shop for two hours per day during the half year. 

When the subjects had completed their blocks, n tcclini(|Uo for fpian- 
tifying the performance was developed.'* Each raw score was imdiiplioil 
by certain numbers ranging from 1 to G depending upon the judged 
difficulty of the task and the number of time.s tlio particular oporalion 
was scored. Neatness and method of dctcriniiuition of position of opera- 
tion were evaluated on a point scale. The number of int(;r\'als on the 
scale was determined by the units that gave the bc-st ai)proxitiiation of 
a normal probability curve. The total po.ssiblc score of 300, divuhul by 
3, left a maximum score convenient to treat and sunitdcnlly largo to 
express fine gradations of skill. 

That our scoring method is reliable is indicated by tlm I'osults of a 
brief study. After eight months of no contact witJi thi.H nwearoh ibo 
psychometrician, who originally scored the boards, ro.scorod tbcni. Al- 
though 82 readings are required on each of the 59 boards tlu! Pour, son 
product moment coefficient of correlation between the Iavo scorings was 


Table 1 

The Means and Standard Doviationa of the Haw Scores on llio Woch) .SImiii Acliiovo 
mcpt Meaeurementa Obtained by tho Entire Group nml tlio Truiiiin^ (Jrfjut) 




First Scoring 

iSiHiDrul iScDi'ing 


Number 
of Doya 

Mean S.D. 

Nurnher 

oUhy fi Moan H.D, 

Entire group 

59 

60.51 14.05 

- — 

Training group 

U 

66.03* 16.62 

14 70.02* 10.00 

Fisher B t for related measures = 4.42, significant at tho 1% level. 


fnr Standard deviation of tJ,,, nuv Hcorcs 

for the entire group and for the training subgroun Tabb. i • 

term, of ftequonoy tho ch.„g», i„ oo„4 „( 1 .. lit ' f u 
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would be found Ichh tluin one per cent of the time if the means did not 
differ significantly from zero. 

A Pearson product moment coefficient of correlation between the raw 
scores for tJie 5!) subjects and their Bind ratings wu.s found to be +.43, 
eignificani at the ono per cent level; n similar coefficient between tliese 
vaUicH and the Avtlnir ratings was found to be +.51, significarit at the 
one per cent loved. 


Table 2 

Tlio Ainmiiit of CluinRo in Scoro.s Betwcon the First Mensurament nnJ tlio Ono 
FolloiviiiB Trninitig in die WikkI Shop (14 indivicliials) 



Aimniiib of Chiiniijo 

Frequency 



-11 to - 7 




- 0 to - 2 

1* 



— 1 (o y 

0 



+ 4 to + 8 

2 



-|- D to -M3 

3 



-1-11U)-M8 

0 



-1-10 to -1-23 

2 



-h2'l to -1-28 

3 



-1-20 lo -1-33 

2 




T - 14 




Mean: +15 



* Considering tins iiistiibility of a number of our children the two (raining score 
(lecroiiiouts nro not uiiuxpevted. 


The Lliatributimi of the raw scores and the retest gains for our group 
iiulieato that the Lcchni(iue has value. The application of this measure 
to u normal or superior population may dciaanrl changes in the prccLsion 
units and the CHtabli-shincnt of norms .suitable to that group. Thorough 
inve.sligatiim of tills toclinique involves control of academic subject 
aclucixnueiit, pre-.sehool ahop experience in wood work, verbal or non- 
verbal superiority,' race, bilingualism, etc. 

Measurements for Mctnl-Shop 

Tbo \vood-.s[u)p study bus indicated that an imtivity can he inciisured 
ilirectly without tliC! necessity of evaluating jicrforrnance through the u.se 
of Icsis tlijil merely Hamplc behavior. There Is no n priori rea.ion wby 
Hueli a tcelmiiiue could not he ('.xtonded to meet the needs of other shop 
activities, for exaupdi^, those of a metal shop. 

To invisstigatc this, another slalT confcrcnci! wa.s held, d’hc impor- 
tiuit activitic.H in the metal shop were isolated, their relative difficulty 
doteriiuncd, mid the precision which our children might be expected to 
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attain identified. Inapection of the work sample evaluated in the Minne- 
sota study (1) did not reveal any one product tliat would sample a.s many 
activities as we desired. Consequently, we dcvcloi)ed foiir pattom.s, the 
reproduction of which necessitates wire bonding, sheet mctnl aoldering, 
riveting, locked seaming, wiring, and circular and angular cutting, 

Thirty-three t4-year-old boys were asked to reproduce the luodol, 
Only the tools necessary for the ta.sk were present and all the [)att(n'n.s 
were accessible throughout the reproduction. In lliis situation the 
measurement is one of the efficiency of tho use of tools and does not in- 
volve their selection. No specific instructions wore given to the Huhjects. 

The scoring pattern is of the same type as that used in tho woocl-.shop 
study. It can be superimposed over the bent wire, the cut pattern, and 
the folded metal. Although we have been able to give hut superficial 
study to this device, we have compiled the manual and scoring Iccy ns a 
means of presenting in detail the important oi)orntion.s that arc amenable 
to objective rating, 

Received February 11, 19U- 



An Analysis of Absenteeism in One War Plant 

Neftl G. Schenet 

}‘ilgin Nulional Company, Elgin, Illinois 

T() wiy iliat iihsdalcoi.sm is of prime importance in iiidnstry today and 
that it is one of th(> larROst i)rol)Ioms to Ijg faced on the homo front ia 
reduiulnnk. Tlio more fact that the personnel man in industry new is 
confronted witli tlic sul)j(!ct wherever lie turns, in articles and on the air, 
as well as in the plant, is proof enough. 

It will 1)0 tlie ]nirpose of the present study to determine the nature 
(uul extent of ah.sciUeeisiH in a typical war production plant with special 
rcforence to the individual and the collective effects of ago, sox, and 
lotigtli of eompany service. Se.x differentials arc always an obvious atart- 
ing iioint, and a review of the literature on the subject shows that ago 
ami length of eoinpany service would be of interest also. Almost any 
other dilTereatiiil could have been used, such as physical characteristics, 
intelligence test score.s, etc., but these appear, at least on the surface, to 
linve little rclatjyn.sliip to the total problem. This led to the choice of 
the variiil)le.s usc<l in the present study. 

Review of the Literature 

la roviewing llie available literature on nbscntccisna, it was found to 
fall gcneriilly into tlirce (ihiase.s; namely, data on causes, discussion of 
records and methods of study, and suggestions ns to remedies, 

Most of the articles liiivc been unscientific in their approach, omitting 
all or nearly all stali.stic.s on lire subject, making only broad generaliza- 
tions, and usually l)cing on iv speculative, rather than on a practical level. 
Estimates, in these writings, as to tlic number of hours lost, types of 
absences, etc., vary widely. Bearing thi.s out, one governmental source 
states, "There is no statistical information available to indicate the 
general extent of abRcntceism in the war industries. Scattered reports 
fi'om a number of factories reflect rates ranging from between two and 
three pei' cent to fifteen per eont or more” (11:2), Certain general 
ehametevistics of ahsent(!eisin, ns given by several govornmcntal i'G{)orta, 
may be mentioned. One source states that ", . . ab.scutccisi'n rates are 
generally higher for women than for men, even on jobs of the .same gen- 
eral character. . . . Greater sickness rates among women arc probably a 
factor in tlieir higher ab.scncc rates . . (11:2). 

27 
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On a basis of comparison of male and feinalo ratcH \vc learn, "One 
large war plant reports current abaonce rates at 4.8 per cent for men and 
7,4, per cent for women. . . • The.sc figures arc typical of. a number of 
reports" (11:2). Age may be a factor of imporbniicc since “a study 
undertaken by one company indicates tbnt absenteeism tends to be 
higbet among older workers, increasing rapidly after forty or fifty years 
of age" (11:3). 

There seems to be a series of effects which cause a teiuloney for 
absences to be numerous on days adjacent to a week-end or holiday, 
"These effects frequently combine to produce . . . tho highc.st (rale of 
the week) on Saturday" (11:3). 

Absence figures appear to indicate that officca, tool cribs, and super- 
vision show lower rates than factory work generally. There is, how- 
ever, no information available, to the writer’s knowledge, to indicato 
whether absences tend to be relatively more frequent on routine aa com- 
pared with nonroutine work, or on heavy versus light work. 

The definition of absenteeism euggested by the United States De- 
partment of Labor, and used throughout this paper, is as follows: "Ab- 
senteeism is the absence of a worker during a full eliift that he Is scheduled 
to work” (11:1). 

In oonolusion, as far aa the writer could determine from going through 
the literature, very little work has been done in tho field of ciuiHes of 
absenteeism, or more specifically, in the field of the clTecl.s of certain 
variablea upon the total field of absences and absenteeism. 

Materials and Methods 

In order to make a meaningful and scientific survey of tho problem 
and yet to keep it within reasonable limits as to size and scope, it was 
decided to break the absence figures down by (1) age group,s, (2) length 
of company service groups, and (3) sex groups. 

For the purposes of this investigation it was decided that one of tho 
plants of the Elpn National Watch Company, by which the writer ia 
employed, be used because of comparative ease of ncccas to ab.scnco 
records, familiarity of the writer with the plont and its pcrsoaiicl, and 
size of the plant. The plant chosen was Company Plant No. 2, manu- 
facturing a mechanical time fuze for tho armed forces. This work is of 
a fine, precision nature, requiring in general a higher typo of omployoo 
than the average factory. The plant has an average labor forco of 
approximately 860 to 900, with about 65% women and 36% men. Tho 
regulation work week at present is six oight-hour days, with Saturday 
an overtime day and not, in the post history of tho company, normally 
a working day. 
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Tlic period of study iiaed wfta the first four months of 1943 : January, 
February, March, and April, The days of the week studied were Mon- 
day, Tuesday, Wednesday, Thursday and Friday. Saturday was omitted 
specifically bccauRG of the fact that absences on this day become of 
importance in and of themselves for certain very definite reasons. For 
example, Saturday is the last day of the week and fatigue will enter into 
the situation; also, Saturday is normally an overtime day and as such 
U GOiiaidorcd as ^Miffercut^* by the average employee. The writer found, 
merely by inspection, that these statements are true in this plant as 
shown by tlie unusually high number of absences for this day in propor- 
tion to all others. It was felt, as a result of these observations, that 
Saturdays sliordd be removed from the study, and if surveyed at all, 
flhoiild be the subject of a further, separate study. 

The ago groups chosen were (1) thirty years of age and under, (2) 
between thirty and forty years of age, and (3) over forty years of age. 
The length of company service groups chosen were (1) three months and 
under, (2) three to six months, and (3) over six months, Subsequently, 
it was found that the length of company service groups were somewhat 
out of line, l>cinE weighted on the aide of longest service. Thus, the 
probable error of rosulla found in some of the service groups will be larger 
than if the cases liad been move evenly divided. * However, in spite of 
this skewed distribution, the facts obtaining in the small groups appear 
to corroborate reasonably well tliosc in the larger groups. 

In determining which statistics to use, it was decided to use the 
number of days lost and also, to disregard any absences under one day 
in length. This last decision was made because of tlie labor of handling 
the data and because, upon inspection, the basic facts appeared to hold 
true regardlc9.s of the length of the absence. ^'It is . . , difficult (and 
u.simlly imneceasary) to tabulate part-day absences and there ia, for 
example, no obvious line of demarcfi-tion between part-day absenteeism 
and tardiness” (11:1). 

Individuals used as Rubjects in the survey were classified as to age 
and length of company service at the beginning of the period; that is, 
on January 1, 1943. Because of a possible error introduced by employees 
entering and leaving the service of the company during the period, it 
was doterininod to use only those individuals who remained active in one 
specific department of tl\e plant during the eoLirse of the study. The 
total nuTidjcr of subjects obtained in this manner wa.s 750; 280 men mid 
470 women. 

The general mctliod used in obtaining the raw data was to use the 
figures on tlic company's "Daily Time Exception Sheet,” which is made 
out by each department and turned in to the Payroll Department daily. 
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On these sheets, only those absences listed ns "R” (Sieknoss) “WP- 
(Without Pemission), and "TR” (Time Requested) were used, all olheia 
(Plant Accident, Vacation, etc.) being omitted ns not jjertinent to the 
survey. In compiling these statistics mid tlinniRliout the sludy, WP 
and TR have been combined into one group which will bo lefcuTed to 
as (Personal). 

A brief word of explanation for this procedure ih m oiav.T hcirc. 
cause of the method of marking absentees iu thin plant, it is felt thtit 
both WP and TR actually contain a great deal of each oLlior and .shoulcl 
not, under the present conditions, be scpanitod for tlio purpos(^H of tins 
study. Absences are reported either by telephone, by a friend of tlin 
absentee, or in person when the absentee returns to ^vork. As a ros\dt 
of this, ii a person called his department and staled, "'I will he iihsoiit 
today because I am going to see the doctor/' one departinent may class 
it as WP because no prior permission was obtained, wUiU) anotlier de- 
partment may class it as TR merely because the pevsou was kind euougl\ 
to telephone and not leave them in doubt. This procedure has l)cen 
verified by the writer in personal conversations with t\u\ various dc])arb- 
ment heads. Since we cannot separate these intangildo amountn of WP 
in the TR heading it appears more logical to group tlicm iogoiiuu’. 

No attempt was made to show the duration of tlio Jibsenccs, each 
fulhday absence being listed as a separate item regardless of wlietlier or 
not it appeared in connection with other full-day absences. That is, 
while we may know how many full days an individual was absent during 
the calendar mouthy it was not recorded wlietlicv or imi iXvimx days 
absent were scattered throughout the month or localized iu one long 
absence. 

When this master list of absences was completed it was jmasildo to 
obtain the number of days lost for sickness and personal reasons by 
department, sex, age, length of service, or by any one or more of these 
variables without regard for the others. Distribution of tiui data by 
these groups was facilitated by entering the pertinent facts upon a series 
of index cards, one for each employee in the survey. These cards then 
contained (1) the name and department of the employee, (2) the age 
group of the employee, (3) the length of company service grouj) of the 
employee, and (4) all absences listed for the employee brolccn down by 
calendar month as well as reason for absence. These cards were then 
distributed by the groups listed above. 

The absence figures were then used to calculate the absenen rjtles, by 

means of the following formula; Rato = tlay.s jb^ljiy gnm)) 

Number of persons in group 

By means of this calculation it is now possible to compare any group 
with any other group or combinations of groups, since we are dealing 
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in rates rather than raw data. Also, in order to provide a basis for 
compiirifion with other sets of statistics, both national and local, the 
al)RenteciHin rates by men and women for tlic entire four month period 
wore fiRured tlirou^^h the use of the following formula, suggested and 
used by the Ihireau of Labor Statistics: 


Ahsenleeism Hate 


Ma u-tlays lost X 100 

Man-days scheduled to work ^ 


Man-days scheduled to work = Number of persona in group X 86, 

the number of work days involved 
in the study. 


There may bo some question as to the use of two diflerent formulas 
for computing a])seiiee rates. Tlic reason for using the first formula is 
to aim])lify the labor involved, since the second formula requires an addi- 
tioiHil computation. It is not necessary to have the rates computed by 
the Bureau of Lal)(jr Statistics formula in all the individual groupings, 
bince there in no method of checking and comparing such figures with 
national or area rates. There obviously is n one-to-one correspondence 
l)etwnen the writer^s formula muUiplicd by 100/86 and the Bureau of 
Labor Statistics formula. 

Uj)on inspection of the data, several differences appeared to be out- 
standing, and in order to determine whether they were significant and 
real difTcronccs or whether they might easily have occurred due to chance, 
standard deviations of certain of these items were computed. From 
these, critical ratios were determined, and results will be discussed later 
in this i)ai)cr. 

Rcfliilts and Discussion 

In a discuHsion of the results of the present study, it would be most 
pertinent to begin with the field of sex differentials in total and proceed 
from tlicre to the differences within each group and the age and service 
differences which appear to stand out upon inspection of the data. 

The most striking fact is that the female rates are proportionately 
much greater in almost every group than the male rates. This appears 
true ihrouglioiit the entire Plant, in all departments, service groups, age 
groups, and totals. In iot^d absences in all departments the female rate 
is exactly three times the male rate, that for men being 1.3 while that 
for women is 3,9. For sickness ai)Hcnccs the rate for women is twice the 
male rate (1.9 and 0,7). In. personal iibsciiees the difference is even 
greater, the female rate being between three and four times that of the 
men (2,0 and 0.6). (It will be recalled that all rates may be thought of 
as '^average number of days lost per employee.*') While these results 
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are in toe generally with those obtained in nlhor HlUflie.H il. Would scpni 
that the differences are even more ijronnuiicnd. 

A statistical investigation of these results yields, in the ense. of lonle 
totals versus female totals, a criliciil ratio of S.f), indienling ii very Jii^ri, 
probability that the difference is a real and signiricanb oiie. lii the (uise 
of male, sichness, versus female, .sickuPHs, the eritieivl ratio is 5.2, and 
it is 9.0 for male, personal, versus fcumle, peiwonul. 

One other fact of interest is that for tim Lolril girnip tlu! .siekiic.-.s and 
personal absences arc about evenly divided, the foriiinr areoiliiliug for 
49% of the totai and the latter for 31%. This i.s at viuiamm witli a 
statement made by Spriegcl and Schulz that "In a Ktiidy of I{»,()()() em- 
ployees of both sexes it wa.s found that the cfuiscs of llicir ah.scuice.s \vci<! 
40% due to sickness and accident and t)0% duo to jaa-.sonal veasoitH" 
(10’.164). However, this may also be duo, to n <liff(M<“u<M> io delinilioiiH. 

In the field solely of male rates, certain faclons apin'ar lo lie of iii( erest. 
The rates for sickness and personal abscncay arc approximately ( ho .‘-nme, 
being 0-7 and 0.6, respectively, showing a fairly <!vc!ii dj.^lrilnition of 
absences on this basis. Of the length of company .service group.s, ( Iroup 
Three, or Over Six Months, appears to be the bighe.st, ei'peeinlly from 
the standpoint of sickness absences. This would luvvi^ no ai>puieo(, (ex- 
planation other than the possible fact that aa length of servicx'. iuereai'cs, 
more adherence to the rules of reporting nb.seiioe.s follows, wbicli wmdd 
lead to classifying many absences as Nicknc.s.i which would ollierwi.sc lx; 
classed as personal absences, becnu.se of not being rcpoi'lcni, 'J'lu' ci ii i(!al 
ratio here for men with more than six mouths servuss vcisus men w ith 
zero to six months service (groups coinbincd Iiccuuko of Ihc .small niimlK-r 
of cases iu each) is 4.1. 

The age groups of the men do not appear to bo. related signilie.imlly 
to absence rates. Group Two, thirty to forty years of age, i.s sliglidy 
lower in sickness absence rates, but not appreciably so. 'I'lii.H seems to 
be at variance with the statement made by Watkiii.s and Dodd that, 

. . the time lost by male workers below the age of forty on account 
of illness tends to be lower than the average male disability, but boymid 
forty, males show a rapidly increasing morbidity ralo" ( iri;2t)(»). Tliey 
also state elsewhere, "Experience indicates that youthful employe's art' 
more careless in the matter of punctuality and atleiuliiuco than arc more 
mature workers" (15:265). While this may bo true in gtuu'ral, I be 
present study does Aot seem to show tln.s to any great degroo in Ibis 
particular plant. The fact that these findings do not agree (uiLii't'ly w il h 
the rraults of other studies may be duo to certain special factors olilaitiing 
in this specific plant. However, it is evident that tho l■( 3 . 4 ltUs are sboiriog 
a general trend toward agreement, since both the younger ami older 
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workm Hli^liHy liiKlwM- in nitu Ihriii Liu; interincdiiite Kroiip, as far as 
flickiK'HH ul)S(!ii(ii'H an; coiiiii'nind. 

Iti (lie field of foiinilo rates, it is apiKirRiit that liorc too, the sickness 
and porsoiiiil uIjsi'iiors iut! iiiHiroxinuitely the siiine, the rates being 1.9 
and 2.0 resiinilivt'ly. howovor, Bervice Group Two, three to six 

nioiillifi, is higln-sl in r.'ite, Itciiig 1.1 higher Lliaii the next group and l.G 
higlier (,han llie lowc.st. 'I’hcve upiK'ar.s to be no logical explanation for 
this unless, aw the. writer feels, there, is a period of oricntiition during 
wliieli the new worker liuids to he (piile regular in attciulaucc, followed 
by a period of laxit y in rejHirLing alwenoe.s, caused, pcrhajia, by increasing 
familiarily with the plaiil., after which tlicrc is a lapse into a somewhat 
steady groove of coopcratioii. I'roin llic statistical .standpoint, this 
difl'erenco i.w not lus .‘iigiiilicaut as sonic others, for the critical ratio in the 
case of women with three to six iiionth.s .service versus women ivith over 
si.v inonth.s .service is onlj’ I.d. However, even tliis critical ratio indicates 
a iirobability of .02 tbat the difference is real. 

Age group on(>, lit) and iiiiiler, is no higlicr than the other groups, 
Honicwliat reviusing tin; linding.s of Watkins and Dodd from the stand- 
])()int. of the increased alisenleeism of yinuigcr workers. However, age 
group tlu'i'c, (iv(‘r d(l, is slightl.v liigher (.haii the other groups, bearing 
out their .slatmiimd., “In the ease of female employees the rate remains 
le.vs than tlie iiverage uj) to age thirty, but iiicreascs beyond that iioint" 
{If); 201)), la the feimde ralew, the service groups show more variation 
than do the age group.s, ns in (he eiise of the mule rates, tending to point 
to the fuel. Ihat lenglli of .service is more iinpoiiant than age. 

Ill the realm of de|>''ii ti>H'>'tid ililfcreiicc.s, ilie oiitstaiuliiig fact is that 
h'inal As.smnlily has more uhsenteeisiu than any other dc])artinciit, of the 
font' large.st oikss. (In disc.u.ssiiig dcpai’tnuiiital differences, only the 
hugest deiiartmenis will lx; u.scd, .sinim contain nearly 89% of the 
total nuinlicr of case.'*.) Tlii.s liolds true in .sicknc-ss and total absence 
rates, and i.s evident in the rales of both men and women employeeg, 
although in the ea.se of men the rate is not markedly higher than in the 
other deparlineiils. In (Ids dei)m'tmeiiL the siclcnc.ss rate of both male 
and feniah' is mneh higher than in the oUuu deiiartments, whereas rates 
of personal alisimvc arc oidy higher in the ca.se of women, and then just 
modmiitely .so. In the ciise of men, sieknes.s, Final As.sembly versins 
men, ricknes>i, Hut)-, Assembly, l.he rale.s Jire l.l and 0.1 respectively, with 
a crilieal riUio of 1.2, imlicaliiig HS dnun'e.s ia 100 that the differonce i.s 
rcid. For womeu in the .sanie eoi)i|)ari.soa, the rates are 2.'1 and 1.6 
re.speclively, willi a eiilical iiilio of 2.-1, indicjitiiig 9!) chances in 100 that 
the difl'emiiee i.s real. 'I'hu.s, the din'ercnce for women is more significant 
than for men. 
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Upon first glftiiCQ this may seem im >'» Telnlively more 

sickness in this department than in <.ther«. 'I’hin in ^imloul>lmlly tnm, 
but along with this, the pcraonnl sihseneoH, nt 1 (muh(, for women, are. tilso 
considerably higher tlmii in the other aepardnenls, ‘I'liiM imriieuinr 
department, having more trouble with nlwnd'ciHiii tliiin the otlierH, has 
been conducting intensive educntionid camimigim on ( In; , 'I'lmir 

main emphasis has been upon the need for iMivployev.-! reiiort their 
absences whenever possible. Also, strong putulivc! inc'umn'M b!iV(! been 
instituted in this department, so Hint, fi>r o.viuaplr, ibree uiu?.\(;ii.Mod 
absences bring about discharge of the nhsmltm. Itowever, iw shown by 
the absence rates, these practices have, not greatly i'vd\U'.e(l tim toUd 
problem. 

It ha 5 been tho general hypotbeflis in tbifj (leparlrn(*nt I lint tlir yonnger 
workers caused the majority of the nlxsencca bore, ilun In irnv 

Bponsibility, etc. The rate oUarta do uol hear i\m n^U, ivml, 

Bfl a matter of fact, they point out that tho yoiuii^er poniniiH in Huh th^ 
partraent (pai^tieulariy the '^vomen) tend U) Uavo loirrr than do the 
older employees. 

It is extremely interesting, as well ae pvvuHng, to note that tin? nli- 
seace rates in general for Final Aflflombly are uppreoialily higher than 
those for other departments, in spite of tho odiieational worls on Llio 
subject and the disciplinary measures in nlloct, Them in nuUiing iijiimr- 
eat in the attitude of aupervisiou here whlclr would UmuI to iullueui^a the 
absence rates, and the psychological factor of working on a (iiuHlied 
product rather than a small, perhaps unrelated part, wliould luivo a con- 
structive iaflueuee also, Since tho employees mmi r(^j)url llioir ubstuioes 
more carefully, it is possible that tlroi’Q ia a ieudeue.y for llu^ sicknewH 
absence figures to increase, for it is much coaior for an (uuployco to Htatc 
that he is ill than to state that he wants tho day off for Hlu)[)i)ing, or a 
trip. However, this does not explain tho increased j^ersoiml al)Sftnccs 
and the resultant increased totals, and there is nothing in the ntudy which 
would give the answer to the unnsuaVeituation obtaining hero. 

Fui’ther study of departmental differences indicates tlmt in both male 
and female, the Plate Department has a higher personal aljsoJicn rate, 
appreciably so in the case of women. For example, in the costy of women, 
Plate, personal absences versus women, Sub-iVHsembly, personal iib- 
sencee, the rates are 4.2 and 2.0 respectively, with a orilitud ratio of fi.O. 
Such a difference is not evident anywhere else in ilm dopai Inuuilal 
statistics. Two factors inherent in tho depavlmont ilHclf Inivo probably 
combined to cause this difference. First, tho typo of work in this dopiu lr 
raent is large, rough and dirty oa compared to that iu tlie oLhci’ doparb- 
mentfl, and secondly, the production schedules in this dopartineut have 
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been Huch lliiit llioro wore poiiks iiiul viilleya in the amount of work 
available lo tlic eiiiiiloy(ieH. .Selcelion of omploycca for this department 
generally led to plneinR Icsk Hhilled labor there, and such persons tended 
to 1)0 rather irre.s|)oiisil)U) in their nttendnnee rccorda and in reporting 
their absonceH. Also, since j)ro(Iucti()n varied so greatly, a certain 
amount of rcsmd.mont nnd laolc of interest on the part of the employees 
was dotectihlo, loading to liiglicr alwcnleoLsm, During the period of the 
survey, a tomporary hiy-olT wus in progresH in this department, nnd wliile 
these hguroH wore not included in this study, the psychological effect 
upon the r(‘inniiiing etnidoyecs, from the standpoint of their apparent 
need to the plant and their job security, may have been reflected in their 
attciulanco rnctirdn. 

A brief word 'm in order from the standpoint of the total plant aa 
compared to oilier plantn in the mine area and to national figures. In 
general, llu^ ahseiice rates arc very low compared to other similar plants, 
pcrliapH due to a conceatiated |)rograin against abacntceism and the 
generally higluT type of employees, on the whole, as n result of the pre- 
cision quality of the work. The following table gives the pertinent facts: 

Tal)le 3 


hcrcenlnKO Absoiiro IldtcM, April 1013, and rorcentago Women Amang Wngo 
I'JnriiorH, April 1013, in Soloctcd IiuliiBtrica * 


Iruhislry 

Absence 

Rato 

Per cent of 
Women 

Amnaiiillior) (Naliuim]) 

5.4 

15.8 . 

TCxplfjfiivoa (Niitional) 

3.8 

16.3 

IiififniiiinntB iiiul Oplirn! Ktpiipmont (National) 

0.3 

36.6 

AUllcportiiiK MunnfiintiiriiiK KsUbliHlimonts (Nalional) 

0.2 

22.3 

Maniifnc.iuriitg MsUihliHliinciiU in Kli^in, Illinob 

5.2 

20.7 

Company Plant No. 2 in KIgiii, IllinoiH 

3.42 

06.0 


^Sourcoai Nnlioiiul Kij^nrea: Ihircnii of Labor StaListicB, U, S. Dept, of Labor. 
I*jlj 4 in 1*' i 11511 rc 8 : Personal Survey by the writer. 


Tlioso figures are of sjmcial interest mainly because of the fact that 
in Company Plant No. 2, although the percentage of women is much 
higher than in the other iiuliistrics, tho absence rate is substantially 
lower than ilie avenigi!. In other words, the total situation is very good 
when coinjjiirctl to both area and national figures. 

Suininary and Conclusions 

In geaenil, a.s a result of Lhe study, the following facts become evident: 

1. Womou luivo three times as much absenteeism as men, in total rates. 

2. Women have approximately twice as much sickucaa absenteeism as do 
men. 
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3. Women have between three and four liniert uh much iK'rM.Hid iilii-Tuloe, 

ism as do men. , ^ i ,1 

4. It is apparent that these differences arc the result fff Hie varuilde, 

since they are evident in every age nml sewiee group aiul drpiul nu-nt. 

5. In general, sickness and personal absenm nnrn nearly rvmly dividnl. 

6. Age groups show no great difference in rates, althougli lliere is a sliglit 
tendency for the older employees to be abwMit more. 

7. Service groups show more variation, with the rutrs Iriiiling 1o inenMiso 
os service increases, up to a point at iiboul six inotillis of 

8. Final Assembly Department has the highest rates in liolli sieku(‘sH uiul 
total absences of all the major departments. 

9. A striking difference is shown in the case of the persfiiial .'ilLspn(‘(*.s for 
women in the Plate Department, the rate hero being inueh higher Hum 
in any other major department. 

In conclusion, it would seem that the findings of tliis study on Urn 
subject of sex differentials tend to agree with other similur iuv(\s(igatiimK 
as reported in the literature, The age groups slmw no londiuu^v toward 
being of importance in influencing the nbsenco rates, and tlio Iciiglli of 
company service factor would appear to he of nuin* import unco boro, 
from the standpoint of influence upon absenUMism. 

Probably the most important findings of the .study asid(? from llion 
mentioned above, are in the uncovering of the two utrikiug dcpurUncutul 
differences, that is, Final Assembly in total al)senUioisin, ami IMalo in 
personal absences for women, While the resultu in Ibo casi* (ff Final 
Assembly are not such that it ia possible to give the answer to Lliin uituu- 
tion, they do serve to focus attention upon tho problem ami to disprovo 
one possible hypothesis; namely, that tho younger workers are cjiusiug 
the majority of the absences in this department. 

Received November 3, i943, 
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Testing the Pulling Power of Advertisements by the 
Split-Run. Copy Method * 

Joseph Zubin 
Coliwibio {/iiu'fr"i(|/ 
and 

John. 6. Peatman 
The City College of New York 

Many different methodB arc employed by the adverlisiiif; iiulii.slry for 
the purpose of determining tlic effect of ndvcrlisiiig co]iy on huU-h. One 
of the most common methods is that of "split-nm copy” h’.sting. 

The method itself can be briefly described ns oiK! in whi(!li two (or 
mote) forma of a given advertisement arc printed in n imw.spaper or 
magazine of a given issue, the advcrtisenmiils being nlfenmled in the 
production of the publication medium ho that the differ(>ilt fonuH will bo 
randomly distributed to the reading public. When pTOp<*rly carried out, 
such a method should achieve the desired end of seeAiriug two randomly 
selected groups of the population under Htndy, cri\ml in nizi', oim of \vhich 
is exposed to the first form of the fldvcrtiBcmcnl and Uio ollmr to Iho 
second form. 

The relative pulling power of each form of the copy is then imuism cid 
by the number of replies received. All copy te.stH tlurrcdore need to 
include an offer of eomo article such ns a free sample of llm ])ro(hict or a 
souvenir. This article should be sufFicioiitly nttracli\’c to cull forth a 
volume of response large enough to be subjected to a Hlati.Hlicnl le.st of 
the significance of the difference in pulling power betwonu llm Uvo forms 
of the advertisement. The free offer needs to he towards the end of 
the advertising copy and relatively inconspicuous in order to iusvjro that 
the response is brought about by the reading of the copy itself nvlhev 
than by the attractiveness of the free sample or Houvenir alono. 

An example of a split-run, copy test is given in an arlicle hy Manville 
(3) in which the problem was ”to dotevinino the relative pulling power 
of the words ‘Taise Teeth' versus the words 'Dental Tlate.s’ iu iKuullim-H" 
of copy advertising Tolident, a cleanser for fake teeth. T\vo Hplit-rviu 
tests were made, one in the Now York Times Sunday Magazine Seclioii 

. Tho eethors wish to thank Miss Jano E, ParwoH for (Irnwiiiu tho iiQuiuprranhH 
included in this paper. 
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find tlio Kcoond in tlio Now York Noth Simcky Rotogravure Section. 
The rosuIlH ohliiined ure Hnuunurizod hy the author aa followa: 

1. TJ)o Now Yf^rk I'imoH 8j>Jil-r«a copy tent, made March 9, 1941, 
yielded a nurnher of replica, ,01,4 jjer cent of which were from the F.T, 
('Tklh'O Teeth") eojiy and 48.6 i)er cent were from tlio D.P. ("Dental 
Plate") copy. The a\ilhor Hfaten that "thia ia wluit may bo called an 
inconchjHive re.sult; wlu^re He))avati<m between tlie competing udvertiBC- 
mentahowrt 1 (*sh than Urn poiTiin (not 10 per cent) difference. ‘ Polidcnt's 
experience han Hhf)wu Unit no malarial difference exlats between two 
tcatod advert iHcinentsH. Ifowever, in conchiaioii, note here that Talfio 
Tcetld waa a Hliadf^ better," 

2. The roHnltH of the Hccond fiplit-run test made in the N. Y. News 
Sunday Rotogravure Section on Sei)lembGr 20, 1942, yielded a aefc of 
rcpIicH, r)2.r) per c<Mit of win’ch were from the F/f, copy and 47,6 per cent 
from the D.P. coi)y. The author presentH these results, stating "here is 
another tuHt run to verify rcHults from the first teat. . . , Again Talse 
TceLld was a shade Hlronger - almost mathematically perfect." 

Since the author gives only tlie porcentiigc of returns for each copy 
but does not give the f olnJ ninnber of rotunis, it is impoasibJe to evaluate 
the significance of his resnUa on a Htaii.stioal hasie, Furthermore, even 
if tlie author had given the al)Hohile frequcncieH instead of the percent- 
ages we would Htill he unable to treat the results statistically Bincc we 
have no kmnvlcdge of the number of readers who arc potential buyers of 
the jiroduct but failed If) respoiuh The hitter data arc rarely if ever 
known even to the research worker, If wo wish to evaluate the above 
results despite this deficieney, certain assumptions must be made regard- 
ing the iiurnhor of replies as W(3ll as the total number of readers who arc 
potential buyers r)r the product advertised. 

\Vc shall present in this paper several general methods for evaluating 
the results and apply them to Manville's data as an oxamplc, In order 
to test the fiignifieance of his results, wc shall proceed on two alternative 
a^mptionfli 

Situation (A) : that he received the minimum average cited by Sturgia 
(4) of 100 replies per lesRid advertieement or 200 for both; 

Situation (B) : that he even may liave received as many as 500 replies, 
on the average, for each of his tested ndvertiaements or 1000 for both. 

luaHinucli m the greatest dilTercncc in the two npliRruu tests made by 
Manvillo was obtained from the Daily News, wc shall confine our ex- 
amples to the.RO figures, namely, 52.5 per cent for the F.T. copy and 
47.5 per cent for the D.F. copy. 

‘ It is clear tlmb on atatiHlical grouiulB aloiio^ tliis Btiitcmenfc is not bonnblc. Tlio 
nbsoluto dillorcncQ botwcon two per centa esn not bo ovaluated directly, but must be 
referred to its standard orror. 



42 


If ManvUlo rcccivocl a total of 200 . ia- v. .a,!,| have, 

received 105 (52.5%) fvom (helvT, rapy and ' 5. , i «'■''» '!«, l),I. 

on the othev hand, wo awinuo dial h<- ri c. iv» i! a. 'tiany ic- KKlfl 
repUi he would have received 525 fnnn da- h-T. .>.,py aud t .a hour the 

^ ^With^an estimate of tUc iiclual aio/ihir «f r- i'li- :• r. * *-)', i d Inr 
copy, we are in aposilion to tost Iho s5y»ilivo>vv M Ha- r, mi <■., I m( w o 
say, whether the IhT. copy really lia<l more puHiiH'. le.v,. r l .an llie I).l . 
copy or whether the diffevenco in siieh a-i lo la* anril.ndd.te In ehauce, 
Unless wo assume, howler, llml. lUe n-lilies wen- .d.f.uned inm. a very 
large sample ' of potential Iwyers of thi' produrt f- (he mlvevl ce- 

ments, we will need to estimate the size of (he miajd'S A . he"«'e vve run 
make a statistical test for the sinmheauee. of the t. Mill . \\ o eltall ilhis- 

trate the development of the lest of Kinuilieauee h-r lo.lh .•inajimilaan-'i, 
that is, the one in which wc as.sinnc a very larKo sain))!*- (lIHhtWWl ov inme) 
and the other where Urc sample may he relatively i-niaH (eav 2(KH)). 

Both procedures assume that lire twover.iinna of tin* ropy I n l>e (I’stod 
are equally and randomly distrihuted amonK v<':ith'rn who are polvudal 
buyers of the pvoduot. It Bhould be iippnrenl, that an editnale nf (he 
sise of such groups would not in this parlle.iifar eane. Ini etjual I n Itie totiu 
circulation of the paper on the day of the test. M<'l, i>Yi>vy one nf (he. 
readers of the paper would be a polmilial buyer of (he. eleanver. I he 
actual circulation of the News on the day of tin; le.st rvaa rcpnrled as 
2,175,429. It is, therefore, safe to assume, thCit (Im aetrml number of 
potential buyers exposed to the copy was eon-Hidorahln, 


Table 1 

Hypothetical DiatvibuLion of Ilcflpoiwc^'i to ibo l'\T. oini I)-i\ 


Potcnbiftl Buyers Exposed to Copy 

F.T. Copy 

D.l', <!.))>>> 

Responded 

a 

r 

Did not reapQud 

li 

i( 

Totals 

N/2 

N/2 


(I '!* c 

i) H- 
;Y 


Assuming then that the two vowionfj ot tlio u(lvortl'ic*in(*nl/ ic'iicIkmI 
groups which WGT0 equally saturated wiUv petmtial (mym, nvu eu\i draw 
up the hypothefeienl two-by-two table shown in Tn))lo b 

2 Large Eis compared to tlio autaLcr of icttiruB. Tlio diftcwiiidou of iLo 
of tliQ relative she of N will he ttoatcjcl latar, Nota that Iho iiwlwloi^ ivU 

poteatiol buyoTH of the product who wero exposed to Uio advortiiiing copy, nod aot 
toeroly tho n\anV)or of Ihoso actually loplyiag. 
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\\\n)Ti) a ifl U\ft nuinhor of potential Iniyera who read the F.T. copy and 
responded, b the 7uiini)er of p()t<3ntinl buyers who read the same copy and 
did jwi respond Tlic letterw c and d represent the corresponding data 
for the I hr. copy; in the total number of readers who are potential 
buyers, half of wlioin, iV/2, rend the l‘\T. copy and half the D.P, copy. 

liCt UH define (he ‘^pulling poweP' of an advertisement aa the pvopor- 
tiem of i)ot(uiliul buyers wJio read the copy and were sufficiently moved to 
nuiil in the eo\ii)un lit the cud of the copy. The pulling power of the 
I'Vr. copy is lli(i i)roportioii a/(///2), and for the D.P. copy, c/(iV/2), or 
2a/iV and 2clN re.spc(itivoly. 

Ill ()rd(U' to d(it(irrnine whether the difTcveuce between the two ' 'pulling 
powers'^ is Hignificnnt, we apply the simple test for the significance of the 
(lifTereucc between two per cents. The critical ratio of this difference, 
CIt, is: 

(T) Pf? = 2«/Ar - 2clN ^ (a - c) 

^ + 2/JV] VpgiV 

whore p — (a + c)/A^ and (/ - 1 — (a + c)IN, 

This cfpiation i.s somewhat dilTercnt from the usual one given in some 
elementary t(3xts but it is the more correct form and the justification of 
its use is given elsewhere (5). 


(ID 


Hence, C7il == 


g — c 

V(^T^r^ (a + c)m 


In order to remove the wpiarc root sign, we can square both sides of 
the equation and obtain tl\e expression for Ghi-squarc, 


(III) 


(67i)^ = X’ = (« - c)*/[(« -h c)(l - 


Fi.slier and Yates (2) have pointed out that whenever the amalleat 
expected frequency (number of respon.ses expected for a given copy when 
cluiiice alone or some other dcfiiiitG hypotliesis is assumed to be opera- 
tive) is le.s.s than 500, a correction for continuity (designated by them 
ns the Yates correction) sliouUl be applied. This consists of simply 
reducing the net value of (a — c), tlie difTercnce between the number of 
rcMpon.scH for tlie two eopie.s, by unity. Ilencc equation (III) becomes 

(in') X’ - [|a - c| - !?/[(« + c)(l - 

Let us now api)ly tliis cf|uiition to test the significance of Situation A 
where the total responses were 200, 52.5 per cent for the F.T. copy and 
47.5 per cent for D,P. copy. First, however, wo must make some assump- 
tion regarding the sample size, N, the total number of potential buyers 
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who read the copy, regardless of whether they responded or did not 
respond. 

Case 1—Few Replies from a Large Sample: Number of returns very 
small compared to the ioial number of potential buyers exposed to copy, 

Lei us assuiae for Case I that the number of returns is negligiblG 
(leas than 1%) compared to the total number of readers who are potential 
buyors* In this inatanee, eejuation (lUO reduces to a much simpler 
form, as follows: 

If the proportion, (a + c)/W^, is negligible, or approaches zero, then 

(IV) X® = (la-cl -iyi{a + c) 

and for situation A: — (9)^200 = 0.40, P = .50, 

and for situation B: x® = (49)^1000 = 2.40, P - ,12. 

In both of these situations the difference is not statistically significant. 
Hence, under the above assumption of a very large sample of readers 
w^ho are potential buyers, the hypothesis that the two advertisements 
were equal in pulling power is quite tenable; consequently, Manvillo's 
implication that the F.T. copy was really more effective would have to 
be rejected. 

We might reverse the question and ask how large should the difference 
have been in order to produce a significant difference for situations A 
and B. Accepting a value of x* = &M5 (P = .01) aa the lower limit of 
significance, we must solve for a and c, with (a + c) equal to 200 in 

situation A and to 1000 in situation B. Hence, wo solve equation IV 

for the value (ja - c| 1), aa follows: 

(V) (|o-cl -ly^xKa + c) 

After determining the value of a - c, we can readily determine a and c 
respectively, since (a + c) is known. 

For situation A: a = 119 and c = 81 (or o == 59.5% and c = 40.5%). 

For situation B: a = 541 and c == 459 (ox a = 64,1% and c = 45.9%). 

Consequently for situation A, if one copy had brought 69.5% or more 
of the responses (and the second 40.5% or less), the difference in the 
respective pulling powers would have been significant. 

Similarly in situation 13, if one copy had pulled 54.1% or more of the 
responses (and the second 45.9% or less) the differenco would have been 
Bignificant. 

We have prepared a nomograph based on the relationship of equa- 
tion (V).* It has been plotted for values of total volume of responses 

■ We decided to deal with ahaolutc frequencies in equation V rather than with per 
cents (which are tnoie gencralh^ used by advertising men) because the equation in its 
par cent form is much more complicated than in its absolute frequency form. The 
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from 100 to 10,000 and for differences in reflponHDS between two copies, 
from 11 to 100. 

Figure 1 is read as followa: When a total number of potential buyers 
exposed to the copies is extremely large, then for any given volume of 
responses [a + c) tlicrc will bo a range of i^ossiblo difleronces in responao 
(o — c) to the two eopioH, HOJnc of wliich will be aigniricaut. To deter- 
mino whether the difference between a given set of replies is signiflcaiit, 
proceed as follows*. 

The total volume of responses (a + c) is found on the line fco the 
right, and tlio difference between the frequency of responBO for the two 
copies is found on the line to the left. By joining these two points witli 
a ruler the exact value of P can bo read from the middle line. This 
value of P indicates liow often a difference aa largo as (or larger than) 
tlie one observed could arise l)y chance. WlDcn this difference is so large 
that it can arise by chance less than 1 time in 100 (P = .01) the difference 
ia regarded as atatistically Higuificant. When tlie value of P or the 
observed difference lies between .05 and .01, the result is doubtful, and 
when P exceeds .05, the difference is regarded as insignificant. For 
example, when the total volume of reaponses ia 200 and the difforencs in 
replies between the two copies is 19, the value of P found from the nomo- 
graph ia about ,22 and hence not Hignificant. 

The nomograph of Figure I can also bo used to determine how largo 
tlje iobn) vohime of responses must be in order tliat a given differcncB in 
repHoa will be significant. Tlius, when the differenco ia 50, there must 
be no more than 375 total responses if the difference is to remain signifi- 
cant, since the signiftcanco of a given absolute difference decreases as the 
number of I'eplies increases. 

The nomograph of Figure 1 may also be used to determine the miniinal 
aizo of a difference in replies between two copies that will yield a aignifi- 
cant difference for a given volume of responses. TUua, for a volume of 
500 responses there must be at least a difference of 58 in the two sets of 
replies, for the result to be significant. 

former may be wfitton aa follows: 

(V^) x' - Clp^ - vt\ - + c)?(» + c) 

In ordor to take care of the factor I /(a H- r) a double noiiiogmpb would Imvo to bo uned 
instead of the mnglo nomograph which is Biifficient for equation (V). Had we nnglcctcd 
tlio l/(o + c) factor completely wo would have ovcrcatimatod the val iio of x (tho root 
of X* which equals tlio vnluo of tho critical ratio) by as much ca 1/Va c. Vor ]00 
TcplicSj X is overeatimated by .1. Thia is a email enough error, but ita nizo was not 
realized until after tho nomographs were drawn. The nomograph in its pet cont form 
has ainco been drawn up and may bo obtained from the aiitliors. 
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Wc cun iihi) d(4(?rmi!Ui llui .sif^niricanco of the iusuUh obtained from 
coiribiniii^i; two hulei)L‘n<(eut split-run co))y tesln. Thus, if wc were to 
combine tlio valu('s 4jf x’ Kivfii by Nomograph I for I, lie icsiilbs yielded 
by the New York 'I'ime.s and the News wc would obtain tlio follo^ving 
results fur mluidion A ami situation H (1). 

'J abl<j 2 

SignificiiiHio of tlin in Kriiiifmi-r. in Uio l‘Vl\ niul I).P, Copi(*s for ilio Coin- 

liiiinil Ursulls of tho Splildiuo C opy TohIs in Iho Tiiiujfj and tlio Nows 


For iSitrratioii A Fnr.SlUifitiofi IJ 

(<j \-c) - («d*c) = lOOO 

D.F. 


Times 

.i2r> 

1 

0.7-1 

I 

New a 

.-lOf) 

* 

2.40 

I 

Total X* 

.sari 

2 

3,14 

2 

P 

.KO 


,20 



♦ Ua<i m be coiupulcd ilireetly becauhc nomograph did nut extend to uuch low 
vftlucii. D.P- ropn^'ioidn drgrrrs of freedom. 


Under the UHs\iinption tluit a tntul of only 200 responses wna received 
for tlie F.T. and D.P. copies (situation A), tiic combined rcsulta for the 
di/Terciic(3 in respenw! i?i both newspapers would arise l>y elumee about 
8Q tiinos in 1(K) and nneh a dilTcrencc is not Htritistionny signiriciuit! 
Under the aHHiunpliun that lOOl) ro.sponscH were received (sitiiatiuii B), 
the combi iHul results indicate Unit chance nloiie would accoiiiii for the 
difference 20 times in iOO, whicli is again not sigiiifieaut. 

It should be [jointed out here that Kince tlic total niunbcr of rcaponsGs is 
taken fct> be at least 200 for silualion A, the number of resj)onses exjiected by 
chance for eaoli copy is 100. Uislicr and Yates (2) have indicated that when 
the smallcHt ex[)cctGd frequency is not less than 200, the value of when 
corrected for continuity will give ji good apjjroxirnntioji of the tJUie proimlnlity. 
However, when the number of total responses falls mucli below 200 the method 
of usually fails to give a good approximation to the true probability. In the 
case under discus si on, however, since tlio two eon trusted groups of readers of 
ho til copic.H are considered equal in iiiiinlicr, the stringency of the aliove rule 
can be relaxed. It has been found in practice that wlicn the two contrasted 
groups arc (upuil, the method f)f Clii-squaro is still iLpijlieiible even wlicm the 
BinallcHb cjxjjeelcd freciuency is as low as 5, that is, wlicii tlie Lota! nuiiibor of 
rcsimnses is only 10.* 

‘The render may woiuhsi- wlieUier it sh fair to considor only the two (UjlumiiH of our 
2X2 table in juilging wholijcr the eoiitra»stc(l groups arc equal. When wo compare 
the two rows, the (aaitnisictl grouiJS arc far from cc(iiiil. However, the value of is 
independent of whether wc compare the roiv.s or the oohniinH. Ile/iec, equality in eithor 
is BulTicieut. 
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Case II—Beplies from Small Samples: Nujuhcr of returns large com- 
pared to the total number of potential buyers exposed to the copy. 

We can now turn our attention to the second possibility provionsly 
suggeated according to which the number of returns represents a signili- 
cant portion of the total number of potential buyers exposed to the copy. 
Let us accept a sample of 2000 as such a number, 1000 for the F,T. copy 
and 1000 for the D,P. copy. Then tho 200 responses of situaliou A 
would constitute 10% of the total sample, and the conesponding proiior- 
tion for the 1000 replies of situation B would be 50%. Wc can now con- 
struct Table 3 for situation A, Case II. 


Table 3 

Data for Situotion A, Case II (200 replies from a satnplo of 2000) 


PotentidBayeTa Exposed to Copy 

RT. Copy 

D,l\ Copy 

TotiilH 

Responded 

105 

05 

200 

Did not respond 

805 

005 

1800 

Totals 

10(X) 

1000 

2000 


Table 3 is constructed as follows; First, Manville's vftluc.s of 52,5% 
(or 105 returns for the F.T. copy) and 47.5% (or 95 returns for the D.P. 
copy) are entered in the first row of tho tabic together with tho total 
volume of 200 replies, Since the total sample of potential buyers is taken 
as equal to 1000 for each copy, tho diffcrcncca between lOOQ and the 
number of returns for each copy are entered in tho second row of the 
table. Finally, tho marginal totals are entered. 

For Table 3, = -45 with a P value of .50, and hence tho dilTevoncQ 

in pulling power between the two copies is not significant. 

For situation. B, Case II, we obtain the rwults of Table 4. 


Table 4 

Data for Situation B, Cmo II (1000 replica from a camplo of 2000) 


Potential Buyers Exposed to Copy 

F.T. Copy 

D.P. Copy 

Totals 

Responded 

525 

475 

1000 

Did not respond 

475 

526 

1000 


1000 

1000 

2000 


Here again the difference falls short of being sicnificiurt y” = 4 8 
(P = .29). 

In other words, the difference in the pulling power of the two copies 
is again found to be non-significant for both situations A and IJ, even 
when the total sample of exposures is small. 
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\Vf(> cun now r<-v<TMi (fic inoMcin jmtl (Jc.tcrmino wlum n (lifferenco in 
piillinn jiowcr will In- l iKnilicuiit. if I ho lulul wnnylc connistH of only 2000 
polcntidl l;iiyrr.-i cxikc i-d hi (lir <'ojjy, 1000 for Uic F.'V. copy and 1000 
for Die 1)1*. and with llic lolul iiuinlicr of returns taken ns 200 for 
siluftlioJi A iijol IIHH) fur silijutioj) Jt, 

SolviiiK ct|na(i(in (III') for (|n - cj - 1)’, wo obtain 

(VI) (l« rl - l)> .;;^5(„..|.c)[l-“+-? 

Hinui wo kiKiw iUv value cpf n >|- r, wo oau hoIvo Ihc c(iuation readily. 
For fjiluuiian A (2^M) roplio,H from u totiil «arni)le of 2(K)0): a — c = 36.6C; 
nnd a h c - 2(K); o - ^ ILS; c * 82. Hoiu-o if iho lolal sainplc of expo- 
Buro,s wenj fpidy 2(K>() imd thr. nispoimea to iUo 1*\T. copy were 118 or 
more (and for flii' 1M\ copy 82 or less) llio (UITercucG would have been 
eignilicaut, 

For fiitnalion li (KKK) rc'plic.H fnuu a total flample of 2000): Solving 
equation (VI): o • 580 and c 171)* IIoiicc, if 630 rcHpondcs or more 
had l;een ntoei^v-d fin,? F.T. copy (and 170 or less for the D-P. copy) 
from a lolal i*aiii]iln of 011I3" 2(MK), llie (lifrerenco would have been sig- 
nilicaut. 

eVisr 111 lirsnJhfor n iSamph: of 4(}()() ICxposures, 

Iv(^t m now (uuisidnr situation A and P, but instead of a total sample 
of 2000 pulniiUal Iniyvra {'xposed to the cojiy let uh nsmiino a total of 
1000 such cxpicmrcs. Paiudoxirally, the value of drops from .46 when 
NI2 - 1000 In .37 whon A72 - = 2000 for tlie 200 replies of situation A, 
and from l.H to 3,20 for the lO(K) rei)lie9 of Hituation D. Both of theao 
values of ani l)elow the rrideid value, of HiRnificance (x^ = 0.635), and 
hence, tlnj <iiff(aenee eanm^t ho. etinHidered HiRuificant. Bub in both eases 
the vahui of detT^^:uu^(| m iV increased. This is pcrliapa unexpected 
since UHUully lh<‘ valuta (d x^ increases as N increases or, in other words, 
tlio siRrn/icanc(» ni a Ri (lifFerencc? increases as tlw) sample size increases. 
We must n'liieiiiluu*, hnwevc^r, that our problem is Homewlmt xmusual, 
since for a given number i>f replies the jmlling powers, 2alN and 2clNj 
decline as i\\ I lie Hi/.(’. of lh(^ sample, increases and consequently the 
niuueralor in e(|nalion (III) also <hMdincH. On the other hand, the de- 
nominator inen^aseii ns N imu’('a.s(\H since the exjiression 1 — (a + c)/]^ 
will incnsise as M iiKM ra.ses, jiroviding (a + c) reniainH unchanged. Thus, 
with llie niiimu'ivlor dccn'iiHiug Juui the denominator ineieiising, the value 
of tli(5 ratifi, x‘t muHt, pcTforre decline. 

Ifowcwer, the value of x‘ iuinnoi dcHdim* jruie/iniUdy, for ns N increases 
indefiiutely, th(‘ value of x'"* aiiproaclies (!« — c| — l)V(a + c) as a limit. 
Tliorcfon*, if the Irniiting vahio of greater tlmn the value 0,635, 
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increases in the value of N wilt not reduce the aignificnncc of the difler- 
ence, but decreases in N will increase the significance of U>e vesntt. Ou 
the other hand, if the limiting value of y} is less fcluui 0.03,), u ilecreiise 
in N of sufficient size may produce a significant difference. 

Case IV — The Maximum Size of Sam-jife that will yield a oiynifieiml 

Difference /w a Giwen iVumfter of Re-plies. 

Since we have determined that the value of dccrcnseH for a given 
number of replies as N, the size of the total sample, in(ii{iiisfi.s, wi; may 
now reverse the problem and inriuire iiow einnl) must bo in order to 
produce a significant difference between the pulling j)Owcr of two lulver- 
tisemeats in a split-run test. 

(VII) Solving equation (III) for N, we obtain 


N = 


(a + e)’^ 

(a -he) - 



(VID m = l/(a + c) - 


Applying this formula we find that N ia 213 for A. IIeiic(? wlicn 
the total volume of replies is approKiinatcly 2Hi or 107 for cnoh copy, 
the results are significant in favor of the F.l\ copy. Wlieii tlic volume 
increases above 214 the results are no longer stafciabically sigiiific/uiL. liut 
what happens when the sample falls below 214? Obviously it eauuot 
fall indefinitGly below 214 since the total sample can novor ))o l(iHS tliaii 
the total volume of responses. In fact, the minimum value for the 
sample size is twice the number of respouaes obtained from the (iop3^ with 
the larger number of responses. This limiting situation is iho one wJiieh 
produces maximum differentiation between the two copies. TIub opth 
mum circumstance is obtained Avhen all the readers of one copy respond 
(a hypothetical situation which will hardly ever occur). In the case of 
situation A, the optimum circumstance for a possible significant differ- 
ence is shown in Table 5. 


Table 5 

Optimum CircuiriBtaacQ for a Possible Signiricnut DiffcTcnco in Sitimtion A 
(200 ropliea) 



F/r. Copy 

D.P. Copy 

Total 

Responded 

105 

05 

2 on 

Did not respond 

0 

10 

10 

Total 

105 

105 

210 



Tcflinij PuUing Poioer of AducHismcnls 


51 


III Tallin 5 thcro i,s a total of 210 rmulrira of whom Iiiilf, 105, read the 
RT. copy and liulf the D.T. copy. Of the 105 who read tlic F.T. copy, 
(ifh'cMiKiiided ; wliih; of llio.se wlio rearl tlie D.P. cojiy, 10 failed to respond. 
Tlic value of (^hi stiuaro for the ahove tahlo is 8.51. Thus, when the 
volume of resjioii.scH i.s 200, of wliich 105 come in ru.Hpoi).S(i to tlic F.T. 
copy and 95 to Iho l).l’. coiiy, we may conclude lliat llu: F.T. copy ls 
B upinior in jiiillinff iiower to (he ]),!’. (lopy as long as the total .sample size 
lie.s between 210, llie ininiinal iiossible size, and 210, When tlie total 
Baui])lc goes much beyond 2111, the din'crenco is no longer statiatically 
siguificant. 

For .situation 15 (1000 replie.s) the optimum re.sult i.s shown in Table 0. 


Table G 

Optimuiu Circuin.Hlancc for a Pos.sililc Sii'iiifinaut DifTercnco in Situation B 

(1000 rcpllM) 



l'\T. Copy 

D.P- Copy 

Total 

UcHpondcil 

&25 

475 

1000 

Dill iiol ro.SpulUl 

0 

CO 

60 

Total 

525 

52G 

1050 


x“ - 50.‘12 and hence the difforcncc in the pulling power of the F.T. 
and D.F. cojiy of Manville's Daily Nows split-run Lest woidd have been 
atatistieally signifieaiiL if Iho total sample of potential buyers exposed to 
the cojiy were only 1050 and thc^otal number of replies received were 
UXX). Such a large number of replies ns 1000 may very well be unlikely 
tor the OIK! in.sertion of tbo iidvm tiseinonts. In any event, it is even 
more unlikely that the more than two million circulation of the Daily 
News inehuled not more than 1050 readers who were potential buyers of 
Polidcut, 

We can now ask how large may JV grow above 1050 before the differ- 
ence liccoincs non-significant. Kiibstitutiiig in equation (VII), 


N = 


( 1000)2 


1000 - 


(d9)2 

0.035 


1566 


Hence, wlicn N is 1500, or 783 I'caders for e/icii copy, tlic difference 
bistween 525 ro.sponHes for the F.T. copy anti 475 for tlie D.P. copy will 
still be significant. However, wlicn the .sample exceed, s 1500, the 
diflerciicc in jiulling power of the two cojiies liccoinc.s .statistically doubt- 
ful. In other words, os long ns the total iiuinbcr of readers (evenly 
divided between the two copio 3 )'dies"betwe 6 ii -1050. aud-I50G, the differ- 
ence in pulling power for thej lJ}(ji[Q b^'gi,t|iaJLiipn D is significajit, 
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When N increases to about ISGG, the difference l)eKinH to fall hoUm the 
significance level Thus, when we !\ave Home cntiinato of Iho numhov of 
readers exposed to split-run copy, wo can <lctonniuo Uw a friveu mt of 
replies whether or not the difference in pulling ]>owcr is significant. 

Two nomographa (IIA and IIB) have been developed winch will 
indicate the maximum value of N that will yield a HiBnificant diffevonce 
between observed results^ Theso arc presented in Figures 2 nud 11 
They are based on equation (VIF). Letting y^{a + c)=^V( l« - c\ - l)^ 
equation (VIL) becomes; 

(VirO 1/i^ - l/(a + c) - 1/y 

We can draw up a nomograph for detciiniiiing the value of y from tho 
values of (a + c) and (a — c) for the situation when = 0 .(j3o {P - ,01). 
This nomograph (IIA) is shown in Figure 2. 

The left hand column gives the total number of responsoH (ti -h c) 
and the right hand column gives the difference in losponsoB l)otwoen tho 
two copies (a - c). The middle column gives the value y which is to 
he used in Nomograph IIB. A ruler connecting the two points for 
{a -b c) and (a — c) respectively will cut the middle lino fit tlio desired 
value of y. Having determined the value of y, wc enter with this value 
of y on the line to the right in the Nomograph IIB and by connecting tl)o 
point y on that line by means of a ruler with the point for tho total 
number of responses (a -j- c) on the line on the loft, wo can kuuI off in tlio 
center the value of N required to render Llio difference significant, 

Example for Nomogra'phs IIA and IIB: When the total niunbor of 
responses to both copies is 1000 and the difference in responses lie tween 
the two copies is 60, we enter Nomograph IIA in the left hand column 
marked (a + c) with the value of 1000 and connect this point with the 
ruler to point 50 on the right hand scale and read off tho value of y on 
the middle scale as 2650, With this value of y we enter tlie right hand 
fioale of Nomograph IIB and connecting it up with the point correspond- 
ing to 1000 on the left scale, we read off the value ot N ^ 1600 on tho 
middle scale. That is to say, when the total number of rcsponsca ia 
lOOO and the difference in reaponse between the two copies is 50, a total 
sample of not more than 1500 potential buyer-readcTs would bo required 
to make the difference significant. 

Nomographs IIA and IIB can be used in any ono of four waya. 
First, to determine the maximum value of N that will yiehl a aignilicant 
difference foi a given set of replies, as was done in the example above. 
Second, to determine that value of n diffci’eaco in replies (a — c) which 
would be significant for a given size sample (N), and a given volume of 
replies (a -}" c). Third, to determine the volume of responses (a -b c) 
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which would yield a significant difTerenco for a given dilTercncc in replies 
(a - c) and for a given namplc size (N). Poiirtli, to determine the 
siRniricnnce of the observed difference by obtaining the value of x** 
directly, In order to utilize Die nomograph for this purpose, only one 
computation is rcrpiired-* I'iisl, determine from Nomograph HIJ the 
value of J/« corre.spoiiding to the observed values of (n + c), the total 
miinbor of replies and (N) the total sample. Secondly, determine the 
value of y from Nomograph IIA whieh gives the value of yA. corresponding 
to tlio olworvnd number of roplirw (a -}- c) and the difference in replies 
(ft — c), Tlio desired value of x* is obtained from the following formula: 

x’ « — (0.035) 

Vu 

Knowing Iho vuliie of ^vo can determine P from any table of 

Discussion 

Thus far wo )mve dealt only with the statistical aspects of the split- 
|nm copy tncliniciuc. However, it is to be emphasized that there are 
'cortnin aRsum])tionfl whicli the technique must satisfy before the statis- 
tical method becomes applicable. These assumptions are: 

(1) That the two copies of the advertisoment have been ao distrib- 
uted among two groups of readers that these gi’oups constitute random 
samplers of the population under examination — ^randomly divided at least 
insofar as the product being advertised is concerned. 

(2) That the two groups contain an approximately equal number of 
potential buyers of the product. (The method can also be applied when 
the potential numl)ei of buyers of the two groups is not equal; in such 
case, however, their relative number must be known.) 

(3) That a valid estimate of the maximum size of the sample of 
potential buyers is available, It should be borne in mind that no amount 
of statistical refinement can compensate for any gross error in the original 
estimate of the size of the samples under comparison. 

* A more direct way of nccompliahing thia purpose is to note tlie fact that Nomo- 
graph IIA is baaed on the value of x’ =■ 6.035 na th e cri tical point. This valuo of x* 
ia found on the y acalo opposibo tho value 31.6 = (VlOOO) on the (n + c) acalo. (The 
decimal point hna to ho provided by the rondor.) By providing a duplicate y Hcalc and 
moving uj) or down wo can let the critical valuo of x’ vary from 0.035 to any other 
value wo plcoao. After dotennining tho value of y for a given observed result by menna 
of Nomograph IID, wo can outer Nomograph IIA end lot the duplicate scale move up 
or down until tlm value of yn liea under the ruler connecting up (o -f c) with (a — c). 
The value of x’ for the observed compiiriaon can thon be rend off at the critical point 
(corresponding to 31.0 on the (o -|- c) flcalc), witli proper care for the decimal point. 
Tho correaponding value of P can bo obtained from standard tables. 
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(4) That the act of clipping the coupon at the end of the copy is 
indicative of interest in the product, and fiirtliormorc, Unit llii.s net wns 
brought about as a result of the reading of the copy, and not an n vcsvilt 
of any other factor. 

When two contrasted copies are found to yield re?nilt.s wldoh are 
significantly different, care must be taken not to placsc too luucli reliance 
on thiajact alone. Tlie efcatistical procedures described fl(^rve to indicate 
whether a differenco in a given set of replies is or is not gveator than 
would be expected on the baaia of olianco alone. Tim aLlril)uLing of n 
superiority in pulling power to one copy over the other mtisl l)o but- 
tressed by evidence of a logical or a psychological kind. If the Tcaiilfc 
flaunts common aenscj the test should be repeated until it is verified 
beyond any doubt. 

If it stands up under repetition, it would be well to ixivesligato tho 
causes of the differences before the superiority of one form over the otlicr 
is regarded as established. Simple methode for coinhining tho rosultH of 
two or more tests are presented by Fisher (1) and an example has boon 
worked out in this paper. 

Application to Other Problems 

The nomographs described in this paper are useful in oilier Hitiuilions 
besides the splitrrun copy technique. They will be found UHofid in item 
analysis of psychological tests when tho two contnisled groups of suc- 
cesses and failures are equal. For this purpose, Nomograi)hH IIA and 
IIB should be used. The advantage of theao nomographa over i)r(3viouft 
ones inheres in the fact tliat the significance of an item can 1)g read off 
directly from the nomographs once the vahies of (a c), {a + c) and N 
are known. 

Whenever the incidence of rare events is contrasted in two groups, 
Nomograph I can be used to determine the significance of the difference 
in the incidence of the event, if the two contrasted groups are very large 
and equal in size. Examples of studies in which many rare cventa or 
characteristics are compared in two contrasted groups arc quite plentiful. 
Among these are studies in the incidence of rare diseases and accidents 
in different racial or industrial groups, Comparigon of the iucideTice of 
rare words in contrasted authors or manuscripts is another exainplo, 
Nomo^aph I offers only an approximation to tho value of tlio exact 
probability and should be useful as a screening dcvico for selectiug the 
Gomparisons that need further study with tho exact methods developed 
by Fisher (1) or by means of the Poisson distribution which is mii table 
for tho evaluation of the Btatistics of rare events. 
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Summary 

In cletcrininiiiR the relative pulling power of two different forms of 
the fiamo advertising copy, a method known as the split-copy testing haa 
been widely used. Ilcrofcoforc only rule of thumb methods have evi- 
dently been widely used in the evaluation of the results of this technique. 
The present article develops simple formuhio which are modifications of 
the basic C!lii-,S(iuaro formula for equal contrasted groups (marginal fre- 
qiiencicH in the columns^ or in tlic rows). One of Uxo difficulties charac- 
teristic of many atudics in this field is the absence of any precise data 
regarding tlic actual size oC the uunrber ot readers ot the odvertiaeiaeut^t 
in question who are potential buyers of the article advertised. Conse- 
quently it becomes necessary to indicate maximal and minimal sizes of 
samples which will yield statistically significant results for a given set of 
returns, Three nornographs are presented for eliminating all computa- 
tioiia and obtaining the required answers directly. Tlieae nomographs 
can bo used for any situation in which a comparison is made between the 
frequencies of nn event (a reply, in the case of advertising copy tests) 
for two equal contrasted groups, Nomograph I ia to be used when the 
frequency of the event under investigation ia small (less than 1%) as 
compared to the total Baniplc. Nomographs IIA. and IIB arc to be used 
when the frequency of the event is considerable (higher than 1% of the 
total Hamplc). The use of these nomographs has the advantage of re- 
quiring no computations whatsoever, the significaiico of the results being 
determined directly from the raw data. 

An example from the literatiiio of a duplicated split-run teat for com- 
paring the pulling power of two advertisements was carefully analyzed. 
The reaiilfca were found to be statistically non-aignificant for each teat 
separately os well as for both tests token in combination. 
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Relationships Between Strong Vocational Interest Scores 
and Other Attitude and Personality Factors 

Leona E. Tyler 
Uniuersily of Oregon 

At the present stage in the progresa of vocatloiuU interont rcscaroli, 
the moat challenging problems arc those coucoriied with the nature of 
the characteristics which differentiate one occupational groui) from 
another. A vast mass of information lin.<j ncoiimulatecl witli regard to 
empirical differences between groups and relationships between difTeveut 
interest scores (4). So far only a few studies luivc attflinplcd to clarify 
and explain these relationships or to fit the traits imdcr consideration 
Into a general theory of personality. 

Purpo.ses of Tliis Study 

The chief aim of the present study was to analyze in some detail 
relationships between scores on the Strong Vocational Interest lilunk and 
several measured attitude and personality factors, Tliis involved going 
behind the correlations to discover, if possible, tohy the scores corrolatcd. 
It was hoped that such a procedure v/ould throw light on the iinturo of 
differential occupational interests and would also add to onr umlovsitind- 
ing of personality organization. It is to be remouibercd that the interest 
tests are practically the only so-callcd personality tests which have any 
objective outside reference. We know that interest seorca refloob choices 
people actually make and plans of action they actually carry out. To 
be able to relate other meoguved eharacteristics about which we know 
less to this reference point would have some real advantages. For the 
author, this study is related also to plans for a longitudinal investigation 
of the development of interests in children. Expioration of the relation- 
ships obtaining for adults shows what chavacteristica are im])ortant to 
observe in a genetic study. 


Procedure 

The subjects were college sophomores taking iiaychology laboratory 
at the University of Oregon in the fall term of 1941-1942, f)5 men and 
122 women. The battery of teats consisted of the StroJig Vocational 
Interesi^ Blank, the Minnesota Personality Scale with its five sub-tests 
measuring Morale, Social Adjustment, Family Adjuslmelit, Emotional 
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Adjustment^ and Econoynic Conservatism ^ tind the Thurstone and Chave 
scales^ Altitude toward the Church and Attitude toward God (No. 22, Form 
A). The Strong tests were scored on the fallowing group scales: Group I. 
Human Sciences; Group II. Technical Sciences; Group V. Personnel or 
Social Scvvico; Group VIII. Office Work; Group IX. Sales; and Group 
X, Verbal-Liiifiuititic. 

The first step in the analysis was the computation of correlations 
betwcGU each of the interest scores and each personality and attitude 
variable, keeping the data for men and women separate. These coeffi- 
cients were chocked for statistical significance by Fislier^s All rela- 
tionships for which the probiilhlily of significance was more than .95 
were selected for further analysis. This consisted of an item analysis of 
tlio personality ineasurement under consideration. We singled out the 
individuals receiving higlic.st and lowest scores on the interest scale. In 
tlie men's gro\ip, we compared the 20 highest with the 20 lowest. In the 
women's group we used the 33 highe.st and the 33 lowest. Tlie person- 
ality test papers of these individuals were removed from the rest of the 
pile, and the responses made by liigli and low groups to each item were 
tabulated. On the Minnesota Te.sl, where the respondent marks each 
item 1, 2, 3, 4, or 5, the mean value of the rc-sponses in each group was 
olALiiued, and the diiTcreuco between means of high and low groups 
chcciccd for significance by Fishcr^s On the Thurstone scales, where 
the response consists of checking or not checking each item, simple per- 
centages were obtained and checked for statistical significance. By this 
method, personality item.s which were clearly related to interest scores 
wore sorted out from those wliich wore not. 

The nexL step, for tests in which tliere turned out to be enough of 
such items to make the task worthwhile, was to rcscoic the papers by a 
key whicli included only the discriminating items. The coirelabion of 
interest score with this special score based on selected items furnishes a 
better estimate of the relationship of interest and personality factors 
than docs the original correlation. For the most significant relationship 
obtained in this way, a further clieck was made. A group of 38 cases, 
not used in the item analysis, was chosen from the aiithor'a counseling 
files. The intcxesi-])eTSDiiality correlations were calculated for this group 
also. 

One problem arose in the design of this investigation, the solution of 
which was not entirely satisfactory. If the women's form of the Strong 
Blank wore used for wojnen siiljjiccts, group scores could not be obtained. 
If the men’s blank wore used, there would be some question as to the 
meaning of the women's scores. Since there is con.sidcrable evidence 
that meaningful scores for women can be obtained with the men's blank, 
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we decided to use it, watching for any indication of Kcx difforoncps in the 
reaulta. Unfortunately, only about a third of the were men, 

80 that the most unequivocal results rest on tlio smaller number of ctises. 

Results 

Male Subjects, Correlations between interest scores nnd other per- 
sonality variables are shown in Table 1, wliich reveals Hcvernl inlere.sting 
facta. First, the iSocial Adjuslmmi teat is the only one frour the jl/innc- 
sota Pmonality Scale which shows more than one significant correlation, 
with Strong scores. The Family and Emotional tests do not correlate 

Table I 

CoTrelationa betypeon Strong Group Scorca and Tersona^ity and 
Attitudo Scores, W = 65 Men 


PoraonEilifcy Testa 



Morale 

Social 

Family 

Emot, 

I'jC. 

C’uilH. 

Attiludn 

Ofid 

AUiliido 
Church ^ 

Group I 

Human Science 

^.24 

-.32* 

,00 

-.U 

-.20* 

-.20* 

.341 

Group II 
Technioal 

>-.03 

-,36t 

.27 

-.00 

-.01 

-.32* 

.32* 

^ Group V 

S Peraounel 

1 Group VIll 
^ Office 

.17 

.26 

-.12 

-.12 

-.00 

.04 

-.20* 

,23 

.14 

-.03 

.00 

.24 

.17 

-.20^ 

Group IX 

Sales 

.03 

,40t 

.09 

.22 

.00 

.38t 


Group X 
Verbal 

-.341 

.04 

-.23 

-.10 

-.10 

-.02 

.23 


' High scores indicate unfavorable attitude. 

* Significant at 6% level (Fisher's teat), 
f SignlfiGaut at 1% level 

with anything. Morale ig negatively related to Verbal interest scores 
and Economic ConservatiBrn is negatively related to Human Science Inteveat 
scores, Otherwise, correlations involving these two siib-te.sts are too low 
for eignificanceL Second, correlations of the Social score with Gronpa I 
and II, on the one hand, and Group IX, on the other, arc opposite in sign 
and approxinaately equal in aize. Third, one or both of the religious 
attitude scales correlate aignihcanbly with all Strong seoreg except 
Group X. The directiona of these relationships are consiBlcut, Less 
religious attitudes go with science scores, more religious with personnel 
and business. 
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Item analysis of the relationship between Group X and Morale turned 
up very little that was interesting. Only three items gave significant 
These ai’o: 2, Joys of family life are much over-rated; 9. A high 
school education is worth all the time and trouble it requires; and 39. A 
good education is a great comfort to a man out of work. The correla- 
tion in this case seems to reflcci simply a slight tendency for men with 
high verbal interest scares to be less optimistic about things in general. 
Practically all the items showed this trendy but in none except these three 
was it marked enough to result in a significant ‘'i*' (5% level). A pessi- 
mistic slant in Group X men may be attributed to either the higher 
intelligence or the larger number of dislikes on the Strong blank itself 
which is known to characterize many men in this group. 

Similarly, item analysis of the relationship between Group I scores 
and Economic Conservatism waa unfruitful. Only two items showed sig- 
nificant diKerences: 18G. If our economic system were just, there would 
be much leas crime; and 193. A man should be allowed to keep as large 
an income as lie can get. Here too moat of the other items showed a 
tendency for individuals with high Group I scores to respond less con- 
servatively^ but differences were slight. Such a trend may again reflect 
nothing more tlian the slightly superior general intelligence usually asso- 
ciated with high Group I scores. 

It was in the item analysis of the Social aubteafc that the most inter- 
esting findings appeared. Thirteen items out of the sixty-five showed 
significant differences between high and low groups on one or more of the 
three interest scales with which the scores were correlated. A scrutiny 
of these items indicates that they have in common one rather limited, 
specialized phase of an individual's social personality — namely, his atti- 
tude about the desirability of friendship with many people. The four 
items on which differences are most pronounced for all three interest 
groups under consideration are: 66. Do you like to meet new people?; 
72. Do you get along as well as the average person in social activities? ; 
84- Do you like to know a great many people intimately?; and 88. Do 
you prefer to participate in activities leading to friendships with many 
people? To each of these questions, the sales group gives a much more 
social answer than the two science groups. Items concerned with other 
attitudes toward people and social affairs do not differentiate. Self- 
consciousness, embarrassment, unhappiness about one's blunders, lack of 
aggressiveness, failure to get along \vith people — none of these has any 
demonstrable vclationahip to the interest factors differentiating salesmen 
from scientists. The social characteristic involved here is a matter of 
preferences rather than adjustment. 

When the Social test waa scored by a key made up of only the 13 
differentiating items, the results shown in Table 2 appeared. There 
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aeems to be little question that the social trait tapped by tUc 13 dis- 
criminatijig items is related more closely to scientific nnd sales /Jiterests 
than is social adjustment i» genctal. The most conclusive cocmcients 
are those baaed on the cases from the files. While the Group I r is lower 

Table 2 

Correlationa between Strong Soorca, Groups I, H, ami IX, nnil Scotch on Scftir.a ior 
MeasurJjjg Socml Adjuetjncnt or AHitiido.-J 



Complete 
Soclul Scale 
(Orig, Group) 

// = 66 

Scale 

(OriR. Group) 
iV -65 

13-Item 

Sciilo 

5 tom Filca) 
^ = 38 

Gtomp 1 

'“.32 

-,67 

',41 

Group II 

-.35 


',52 

Group IX 

.40 

.58 

.00 


for this group than for the original subjects, Group II is about the same, 
and Group IX is actually higher. The full importance of these correla- 
tions becomes apparent when we realize that on the basis of the 13 social 
items alone we could predict Strong scores on Groups I, II, and IX with 
about aa much accuracy os we predict school marks from iutclligcnce teat 
results. 

The item analysis of the Aiiiivde iov^ard God scale showed, as one 
might expect, that the principal dilTerencea stemmed from a tendency of 
the flcientifically-minded to avoid the more mystical positions, such as 
'^God is the underlying reality of life,'' There was no dificvence on anti- 
religious items; few if any of these subjects checked them. On the 
Attitude toward the Church scale, the principal difference between ecicn- 
tists and personnel and business men seemed to be a greater tendency 
toward skepticism among the former about whether or not the church 
produces all the good effects claimed for it. Differential responses to 
such items as *'I feel that church attendance is a good index of the 
nation's morality" are typical of this trend. On this scale also, the anti- 
religious items were avoided by everybody. The difference between 
scientists and buain ess-personnel men might be described as a diffevcnce 
in amount of indifference, not opposition, to the church. 

The last etep of the procedure, scoring the teat on discrimmatuig items 
alone and recalculating the coTrelations, was carried out for the AUiiude 
toward the Church scale. (There were too few items in the otlicr to make 
it feasible,) The outconie is shown in Table 3. Again the coiTelations 
are larger with the scores based on disoriminating items aloiio, but tlio 
increase is less marked than for the social variable. Since on scales of 
this type subjects check only those items with which they agree, it is 
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probftble that irrelevant items carry leas weight in the original score 
than they do where the other scoring technique is used. 

A possibility tlmb a few items on the Strong test that happened to be 
closely similar to the social items wc have sorted out might account for 


Table 3 

CorrclafcionH between Strong Scorca, Groiipa I, II, V, VIII, and IX, and Scores on 
Scales for Meaaiiring Attitudes toward the Church. N ^ 



Comploto 

Att. Church 
Scale 

IWtom 

Scale 

Group I 

,34 

.40 

Group 11 

.32 

.40 

Group V 

-.29 

-.28 

Group VIII 

-.29 

-.40 

Group IX 

-.25 

-.30 


the obtained correlations also needed to be checked. An item analysis 
in the reverse direction was used for this purpose. That is, the responses 
on the Strong teat of the 20 individuals who were highest on the 13-item 
Qocial scale were tabulated and compared with the responaes of the 20 
lowest- Differences showed up on a large number of interest items scat- 
tered throughout all parts of the blank in such diverse areas as, for 
instance, liking geography and handling horses. This suggests that a 
different general outlook differentiates these people and not just a few 
Bpecific preferences. 

Another question of some significance is whether or not social and 
religious attitudes arc correlated. This seems to be the case. The corre- 
lations between the special social scale and the special church scale is .40. 
Thus interest scores could be predicted from a combination of the two 
with only slightly more accuracy than from the social score alone. 

Female Subjects. For the 122 women in the study, correlations be- 
tween Strong scores and other personality variables are shown in Table 4. 
There are more statistically significant r's than for the men^s group 
because the larger number of cases makes a smaller coefficient aigniRcant. 
Numerically, most of the coefficients are somewhat lower than those in 
the corrc-sponding cells of Table 1. It is interesting to note that all the 
significant relationships arc in the same direction for women as for men. 
The principal difference between Tables 1 and 4 is with regard to the 
religious attitude scales. In Table 4 only one of the relationships be- 
tween religious attitudes and interests is significant and that one (Group 
V vs. Aiiiiude toward God) is very low. Group V interests, ^Yhieh for 
men are most closely associated with favorable attitudes toward the 
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Table 4 

CorrolDitioiiB botwcon Strong Group Scores and PcrflonaVity and 
Attitude Scores. N = 122 Women 


PeTBonftlity TcsLs 



Morale Social 

Family 

Einot. 

Ec, 

Cons. 

ALlitnilc 

(3<k1 

AUikude 

Church 

Group I 

Human Science 

-.3B** -.27** 

-.15 

-.20* 

-.12 

.01 

.00 

Group II 
Technical 

-.14 -.27*« 

-.08 

-.07 

-.11 

-.17 

.14 

Group V 
§ PerBoanel 

.23** .34** 

-.01 

.14 

-.19* 

.10* 

-.06 

'g Group VIII 
^ Oifice 

.19* .05 

.14 

,07 

.08 

.04 

-.06 

Group IX 

Saleg 

.16 .38** 

.13 

.12 

.23** 

.08 

-.16 

Group X 

Verbal 

-.09 -.01 

-.07 

-.07 

-.00 

-.05 

.11 

* Significant at 6% level (Figher^s 

"l" teak). 






Significant at 1% level. 

church, aro in 'women most clearly related to social charnct eristics and 
morale. 

Item analysis of scales other than the ^Social again selected only 
scattered items, difficult to fit into a colierenfc pattern. But out of the 
53 items on the Social test (Women's Fotm) 41 differentiated high from 
low people on one or more of the interest scales. A great many of these 
are significant for Group V only. Women high in personnel interests 
give more extraverted responses than others to almost all types of ques- 
tion. A smaller set of 19 items differentiated scientific and sales interests, 
as did the set in the men's data. There is more of a tendoncy, however, 
for items pointing toward social maladjustment to difforentiate between 
these interest groups of girla, For instance, the item, ''Do you find it 
easy to make friendly contacts with members of the opposite sex?," has 
no differentiating value for men, but shows up significantly in the analyses 
of four scales for women (Groups I, II, V, and IX), the more Bocial answer 
characterizing girls with personnel and sales interests, the less social, girla 
with science interests. The results of rescoTing the blanks by the 19- 
item key and recalculating correlations are shown in Tablo 5. Coeffi- 
cients are increased by eliminating non-discriminating items, but not so 
markedly as is true for men. This also may indicate that items having 
to do with social adjustment and happiness are less irrelevant to interests 
for women than for men and thus have a less depressing effect upon 
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correlations. Unfortunately, relationships in the women^a data could 
not be checked in a new group, as the counseling files contained too few 
cases of women who had taken the men's Strong test. 


Table 5 

Correlations botweon Strong Scorca, Groups I, II, and IX, and Social Scores on 
Minnesota Personality Scale. N = 122 Women 



Complcto 

Special 


Social 

19-1 tern 


Scale 

Scale 

Group I 

-.27 

-.41 

Group II 

-.27 

-,37 

Group IX 

,38 

.47 


Discussion 

The facts outlined above can be brought together under a few main 
headings. First, it is to be noted that interest scores on Group I, Group 
II, and Group IX scales are the only ones showing consistent significant 
relationahips to other personality factors. We have uncovered nothing of 
any importance about the other group scales, except that women^s 
Group V interests tend to accompany higher socialization and morale 
and men's Group V and Group YlII intercBts go with a relatively favor- 
able attitude toward the church. The scientific and sales interests are 
at opposite poles in all the relationships investigated in this study. 
Many of Strong's reported results show the same trend (4). 

The second generalization is that there is a social factor related to 
interest differences. This factor, for men, is centered around the sort 
of social stimulation they prefer and seek. The more a man tends to 
avoid large numbers of acquaintances and indiscriminate social affairs, 
the more likely he is to show the interests of scientific men. The more 
satisfaction he takes in social affairs involving large numbers of people, 
the more likely he is to resemble salesmen in his interests. Items having 
to do with maladjustmeuta and unhappiness do not differentiate between 
men's interest types. Women show the same general sort of difference 
between persona with scientific and sales interests, bub the nature of the 
social factor is a little less clear-cut. The same items concerned with 
liking or avoiding social affairs constitute its important component, but 
Bom,G other less-ensily-catalogued items also differentiate. Girls with 
high scientific interests are likely to be somewhat 1d.s.s well-adj listed to 
the opposite sox, somewhat less confident and happy in their social rela- 
tionships than girls with other types of interest. This may be because 
in the direction their interests are taking they are departing rather mark- 
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edly from what society expects of women and nrc thus inlrodueing some 
strain into their xelationships with people. It is impossible to detenniue 
from tile data at hand which of these variables is cause and AYhicli effect. 

A genetic study should throw Uglit on tliese douhtful issues. 

Postulation of an important social factor around wlueli other atti- 
tudes cluster suggests hypotheses explaining several puzzling facts turned 
up from time to time in interest research. Many have woudcicd; for 
instance, why artists should be classified with pliysiciiiuiH, p.syoliologislsj 
architects, and dentists, by the correlations hetweeu interest scores. 

A similarity in social outlook might be the basis for Ihoso correlations. 
The predominance of scientific interests in adolescent boys is another 
such research finding. The social attitudes of 15-yeav-old boys, if they 
cany other attitudes along with them, could account for tliis, The 
correlation of interest scores with success hi selling life iusuvauce might 
also involve this third factor. If the high-scoring men have a different 
social outlook, that could easily account for their selling more insurance. 
All these hypotheses could be checked statistically without a groat deal 
of trouble. 

Another general finding from this study seems worthy of inoution, — 
the general lack of relationship between interest scores and what wc 
loosely term '^neurotic tendency,” There is no correlation for either sex 
between interests and family adjustments. There i.s only one low sig- 
nificant correlation between interests and emotional adjustment, and this 
shows no particular trend in the item analysis. None of the items on the 
social scale referring to relatively serious maladjustments or neurotic 
symptoms differentiate in any interest group. It may well be that there 
are two independent variables in personality, the direction which it takes 
and the success or effectiveness of the adjustment made. We liavc per- 
haps given too much attention to adjustment in personality study, and 
too little to this other consideration of the direction of development. 
There ig certainly no evidence here to suggest that neurotics tend to pile 
up in certain occupations. 

That correlations with religious scales are significant for men but not 
for women may indicate that vocational interesta are a more funda- 
mental factor in male than in female personalities in our culture, more 
closely integrated mth the individuars whole cosmic orientation. As in 
meyst studies, our women subjects averaged slightly more leligious than 
the men, hut the differences were not statistically significant. It is to 
be remembered that the differences in men are not on the anti-religlou.s 
items but on those showing skepticism. The tendency one might expect 
to find for business men to be more conservative than scientists Bho^Y8 
up more plainly with regard to religious issues than in regard to econonoic 
opinions. 
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Finally it should be noted that the resuUa presented in this paper 
coincide in several respects with some other exploratory studies, The 
table given by Darley (2) shows the largest number of .significant critical 
ratios for tlic scientific interest groups and the social .scales, particularly 
Social Preferences, hiavbin and Bevdie (li) find more .significant dilTor- 
enccs in AHinirt-Vcmoii scores for Groups I and II than for the others. 
Tu.ssing (5) finds tliat scoring keys for the Strong blank can be con- 
structed to incinsiire .somewhat the same factors as the Bernreutor F-lC 
and F-2S scales and the Bell Social scale, but not the other Bell scales. 
It would be po.ssible to fit the results of this study into Bordin's (1) 
theory that “in answering a Strong Vocational Interest Test, an indi- 
vidual is expressing his acceptance of a particular view or concept of 
himself in terms of occupational stereotypes,*' if rve as.suTne that attitudes 
toward social affairs and friendships are important features of the .stereo- 
types for some occviiiations, 


Summary 

1. A social factor having to do with feelings about organized .social 
offairs and friendships ivith many people is related significantly to Group 
I, Group II, and Group IX scores on the Strong Vocational Interest 
Blank. 

2. Religious attitudes show a moderate correlation with vocational 
interc.sts in men but not in women. 

3. Scoras indicating neurotic tendencies show no appreciable relation- 
ship to any kind of interest scores. 

Receiued December 1, lO/iS. 
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A 'Wony Inventory 
A. H, Martin 

The Universily of Sydney, Sydney, AujIraJia 

This inquiry originally constituted an endeavour to supply an oUer- 
native form to the usual questionnaire used as a measure of maladjusted 
treudB in peraonality. In place of presenting questions requiring the 
underlining of answers either “yes” or “no,” direct but brief description 
of symptoms were set out. Test subjects were first required to underline 
those items which had ever worried them. When this task was com- 
pleted, they were further required to make a ring around the number of 
any of the underlined items which at present still constituted a cause of 
worry. Two scores were thus obtained; tho first consisted of an “effec- 
tive'' score of worry items; the second score noted existent present 
worries. In administration this inventory proved to bo far easier for 
candidates to answer than the usual questionnaire form of personality 
inventory. 

The questionnaire generally used for vocational guidance work in 
Sydney, Australia, for candidates from fifteen to twenty-five years of 
age is Thuistone's ‘ selected questions, modified by a few necessary local 
emendations and the addition of three “jokers,” i.e., cateli questions to 
which the better answers are “Yes,” 

Regularly each year some undergraduates have commented on tho 
difficulty of following the directions for this questionnaire, The effort 
of fine discrimination required to amve at honest decisions, appears to 
be great. At the same time, the questionnaire does actually sort out 
many cases showing inferiority trends, ehynesB or “nervouenesa.'' These 
individuals may be directly helped by an interview or two involving a 
brief analysis of the subjects' self-centered attitude. There were 42 
questions in tho original Sydney inventory and the average number of 
“yields" per person was from 10 to 11 questions. Self-confidont indi- 
viduals of a good “aalea” type tend to regiater from 3 to 6 yields. Occa- 
Bionally types with pronounced “inferiority” or neurotic trends show 
from 15 to 36 question yields. A Factorial Analysis ’ showa tho ques- 

* Thuretoce, L, L., and Tburstoue, T. G. A nourotio invontory. J, «oc. Piuchol,, 
1930,1,3-^30. 

• Gibb, C. A. PetaonaUty traite by (aotorial annlyaiB. Amt. J. PawcJiol. Phil, 
June, 1W2, 1-16. 
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tiona themselves tend to cluster about aucli trends as schizoidj submissive, 
a- 30 cial and manic-depressive* 

Worry Inventory 

Since the general principles involved in the Thiirstone type of ques- 
tionnaire had proved bo useful for many years, it acemod advisable to 
retain the principle involved and yet to seek some simplification of the 
questionnaire method. Accordingly the direct method was decided on 
for a try-out. Eveiy existing list of worries^ patterned after Wood- 
worth's ^ original lead, tends to be cast in the form of questions. But 
this method is neither economical in its setting out nor is it often easy 
for the candidate to answer. Tho itemized list, used here, however, 
directly denominates each symptom, which has been reduced as far as 
possible to very simple and unambiguous terms. The method of marking 
the items was first to get subjects to underline those which had ever 
caused them worry. After completing the list thus, they were required 
to put a ring around the number of each item wliich was still a present 
cause of worry or distress, Two individual scores were thus secured. 
If the items are honestly marked, the first indicates the general nature 
of individual worries; the Bbcoiid score is indicative of the nature and 
extent of existent worries. This procedure of underlining and ringing 
was borrowed from the method prescribed in the Presaey Emotional 
X.O. Test. 


The Group Tested 

The original group of individuals tested consisted of undergraduates 
attending classes in Psychology in years I, II or III in the University of 
Sydney, together with a few outside persons attending one of these single 
coiiises. About fifty per cent of the undergraduates were students en- 
rolled for evening courses. Altogether 100 persons were used as subjects, 
48 being females and 52 being males. Their ages varied from 17 to 47 
years, but gave a preponderance to subjects of earlier years with a very 
decided skew towards the higher years. The average age for both sexes 
combined was 20.4 years. In order to enable observations to be made 
upon age trends, the scores were separated into male and female results 
under the following age divisions: (a) 17 to 19 years, (b) 20 to 21 years, 
and (3) over 21 years. No dilTcrontiating trends in age or sex appeared, 
cither in yields to particular types of items, in actual numbers or in tlic 
proportion of existent worries to general worry problema. The six sub- 
groups, though fairly uniform in trends, Avere not large enough for any 
reliable inferences to be drawn. Some degree of selection must have been 

* Franz, S. I. Ilaiuibook of mental test methods. New York: Macmillan Co.p 1020. 
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operative in the male section with respect to inilitnry service, hence this 
sampiviiB tfl-n hardly he regarded as “average” and fully representativo. 
In the female section no such faetors of selection probably came into ]jlay, 
The subjects did not record their names on the sheets unless they 
wished, but merely indicated sex and ago. 

The Present Inventory 

The items with their two results given alongside, are shown in Table 1. 
The items were arbiti’arily selected by the writer on a representative 

Table 1 

Items in the Worry Inventory witt Porcootngo of "Ylolda'* for 
100 University Stuctonts 


Percontngo 
of Yields 



P 

II** 

1. Poor health 

20 

7 

2. Being diHeroat ia appearance to other folk 

23 

7 

3. Having a poor appetite for food 

3 

0 

4. Bad indig&Bbion 

3 

1 

6, Lying awake at uight 

20 

Q 

6. Disagreeable dreams or nightmares 

23 

0 

7. Constant aobes or pains 

2 

0 

8. Night sweats 

3 

0 

9. A dislike for certain kinds of food 

21 

11 

10, SpelJa of dizziness 

U 

0 

IL Though ta of death 

23 

6 

12, Being nervous or shy 

75 

18 

13, Sudden heart tremors or palpitations 

U 

7 

14. A tired feeling after waking 

29 

10 

16. Prequent headaches 

20 

8 

16, Entertaming folk 

34 

16 

17. Thoughts of suicidG 

9 

0 

18. Being found fault with 

48 

16 

19. Not taking part in. eporta ox games 

16 

1 

20, Sleep-walking 

3 

0 

21. Being too qiiartclscimo 

13 

2 

22. Loneliness 

26 

8 

23. Bad asthma or shortness of breath 

5 

3 

24, Feeling bored or "fed up" with life 

29 

4 

25. Sexual problems 

31 

12 

2C, Mind wandering or day dreams 

26 

0 

27. Constant bad luck 

3 

0 

28, Being tensed or made a fool of 

30 

7 

20, Not being understood or appreciated by people 

16 

2 

30, Meeting members of the opposite sex 

30 

6 
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Percentage 
of Yieltls 


I* ir** 


31. Reing treated unfairly l)y others 

30 

6 

32. Leaving tiusko unfinibhed 

20 

12 

33. Gelling no ploiUiUTo out of Uffo 

8 

2 

34. Talking too inuoli 

15 

7 

36, Lack of aiicceafl in your sLijdicA 

22 

6 

30, Not being loved at homo 

6 

1 

37. Addrcaaing groups or mcctinga 

38 

21 

38. Doing closely watched or observed 

30 

12 

39. People * 0 wickeduesa 

7 

5 

40. Being n failure in your job 

10 

3 

41, FeeUng BeU-couaclouB 

54 

27 

42. Brooding over your eins 

9 

1 

43, Having wrong thoughts 

23 

8 

44, Geing into tunnels or subways 

2 

1 

45, Not boing your real solf 

10 

3 

46. iSomo speooh diifioulty siicli as stammering or lisping 

10 

6 

47. Looking down from n height 

31 

16 

48. The need to do things over and over 

10 

2 

40, Tilings Bceining unreal to you 

n 

3 

60. Talking in your sleep 

7 

3 

61. Not being able to converse easily witli people 

33 

13 

62. Making one of n crowd 

10 

2 

63. Your lack of true frienda 

U 

5 

64, Bliiflliing 

37 

16 

55. Lack of self-confidcnco 

34 

17 

60. Twitching of the face, head, body or limbs 

7 

4 

67. Your religious beliefs 

10 


68, Some vague constant fear or worry 

14 

0 

50. A fear of going insane 

7 

1 

QO. Inability to Dx your attention on books, work or studies 

2B 

18 

01, Having a bad temper 

21 

5 

02. Being afraid 

14 

4 

63. Meeting with or talking to oklors oreocinl superiors 

20 

7 


* Directions I, First read carefully through every item mentioned below and under- 
lino eueryihin{} which hoja ever troubled or worried you. 

** Directions II, Now go througli each item underlined and if it is still worrying 
you, draw a ring arouiid ita number. 

basis from a wide array of existing ‘'personality^^ quc.sLionnairos. Whore 
two items were uat mutually exclusive atid teiulcd to cover a particular 
symptom, the better, in his judgment, was retained. 

Of all the sixty-three items only seven proved to be unproductive 
by showing a total yield of only 3% or leaa. These items are Nos. 3, 4, 
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7 8 20, 27, and 44. The last indicated that clmislrnpliobia is n fairly 
frequent symptom compared with No. 47, which involves "looking 
down from ft height.” For use with a normal and rcprc-scntative group 
of individnals the seven items could well he omitted, 

The remaining fifty-six questions were arbitrarily (Ufitributwl by the 
writer under the headings shown in Table 2, They are arranged in 
descending order of frequency of occurrence. 


Table 2 

Grouping of Ilcroa inthn Worry Inventory by Cntcgorica 




Averngo Porconiago 



No. of 

Ever 

still 


Type of Difficulty 

Items 

Worried 

Worried 

I tom Numbers 

Sex 

3 

ai 

9 

25, 30, 48 

Inferiority 

21 

28 

5 

2, 12, 10, 18, 22, 
28, 20, 31, 34, 36, 
30, 37, 38, 40, 41, 
40,61, 63, 64. 65, 
03 

Physical Symptoms: 





ConvBraion 

10 

16 

B 

1, 0, 10, 13, 14, 
16, 23, 44, 47, 60 

Schizoid Trends 

16 

18 

5 

B, 0, 11, 17, 24, 
20, 32, 33, 45, 48, 
40, 60, 62, 68, 60, 
00 

IteligiouB Difficulties 

Fear and Anger or Cyoio- 

3 

12 

6 

30, 42, 67 

thymic Trends 

3 

14 

3 

21, 01, 62 

Total 

56 

21 

6 



Psycho-analytio literature would probably technically label these as 
erotic, narcissistic, conversion or hypochondriac, repression, super-ego 
and accumulations of id symptoms and trends. On the other hand, the 
nomenclature of various factor analysts ^ would use other specific terms 
6ueh as "lack of confidente,” "solitariness" for the inferiority and schizoid 
trends. The remainder would hardly find a place, The chief concern 
of the investigation was to indicate certain practical advantages of tlio 
method of presentation and the method of marking the items. 

The results presented exhibit a decidedly different aspect to those 
obtained from the general run of such inventories, both in the matter of 
items, the item gi'oups and the extent of the prevalence of such diffi- 
culties. This inventory, therefore, tends to shed a different light on the 
* Gibb, 0. A,, op, cil. 
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nature of nervouH worries and proljlcins to tliat of the ordinary person- 
ality questionnaire, It cannot, of course; be indicated to what extent 
the disclosures of Ruoh worries was due to the anonymity covering the 
individuals who answered the inventory , but at least one-third of the 
group voluntarily Hubscribed their names. Further the writer was 
brought into contact with the groups concerned as lectUTcr; so that a 
certain degree of ra])port i)OHsibly existed. 

Eo these average frcriucncies really indiciitc the relative importaneo 
of tho groups of itoinH? Ono eunuot answer directly to this ques- 

tion. Ill the first place the lumiher of qucstioim relating to ^'InfeTiovity'^ 
amounted to 21 or almost 40 per cent of tlic total of the items, yet the 
group ranks second in average importance to that of eex diflicultics which 
ia represented by only three items, 

But seven items of tlic inferiority group approach or show a greater 
percentage of yields than tlie most heavily weighted item, No. 30 of the 
Sex Difficulties group. There is, hence, no eonelusive evidence hero 
supporting cither tho exclusively Freudian or the purely Adlerian theories 
of personality. The individual reader must interpret the results in Jus 
own way. It can be stated, liowovcr, that tho present inventory is 
possibly moro "revealing^* in many ways than the Tliurstono Ques- 
tionnaire. 

Later on, both the Worry Inventory and tho Tliuratono Inventory 
were administered to a group of 3C studonts of both aoxes; for tho sake 
of comparison. The following correlations wero obtained: 


Thurfltono Inventory find Worry Invontory Underlining ! . = .81 ih .038 

Thuratono niid Worry Inventory Ringing = ,76 ± .050 

Worry Invontory Underlining and Worry Inventory Ringing. . = ,81 =1: .038 


To supplement this a test of extraversion wa.s administered to the 
same group within a week of giving the others. The results were: 


E^travoraion and Thurstoiio = - ,40 ± .035 

Extraversion and Worry Invontory Underlining = — ,60 i .077 

Extravoraion and Worry Inventory Ringing = — .67 ± .0(5 


Thus, there appears to be a remarkably coiiaistont constant factor 
emerging from all these tests ns revealed by these correlation results 
which is probably that of intro-ex traversion. While its symptoms arc 
legion, one underlying cause, that of cgo-cen tricity, appears as tlie prime 
cause of tho human dilTieiilLics. 


Summary 

I. In the present ''Worry Inventory’' a list of sixty-tliree items was 
presented to a group of 100 university students of botli sexes ranging 
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in age from 17 to 45 years. The inventory is intondtid (o l)c rojirc.scintu- 
tive rather than exhauetivc. 

2. The method of administration of tlie Inventory jjroved .Hiniiile and 
far less difficult to answer than the usual list of personnlily rineslioiis, 

3. Its use tended, possibly under a cloalc of anonymity, lo\YardH a 
higher yield of nervous difficulties and a wider field of Hyniiiloins, than 
is usually uncovered by the usual questionnaire method. J lowe vtfr, some 
fair proportion of the excellent r&sults Is probably duo to tlie diivet 
approach used in the present Inventory. 

4. The Worry Inventory correlated to a very high degree wilh the 
Thurstone Questionnaire. 

Received November ^0, W/i3, 


t 



Sdtial Fnctors Aiui(»ying to Children 
Kuso ZoliRH 

.li' !’i t'iU •’’i V‘ ?, < Vn'irjT’f^jrf, O/ifu 

TIu' iin Hit ’*vmtM (m Hip lifuiiljiinlmcrilx of ditilurl)- 

niicci4 i rilTtrl kliihlrrii riii'l cnutriliiih’ U) innlulnlily 

luid l»rk nf |M 0 M‘, A Kiinvil* mm’iviiiK in <l(iily 

o\|)('ri('M('*"' .' li’PiM ('iiJiiili'' purpiil'i Ipim’Iht*!! In (*lliiiin;ilp ituniy nf Hie 
(lislurliiii^ fapl‘«rf« Mud hi Lrl|i llip i-liiMrcn lo fuinoyaiiais Unit urc 
imavoiilalilp- 

Tliis [iJijti'r uill ili''‘’n' I’hiMn iiVi rracMniis h) {innnyanci's llioy often 
cxpcricniM^. ^l lo' i'4iiM|iri! tMl l lo f’ixlh"|.n’a(lo Imyn and J'lO riiIh 

from lv.'n Mihnrlian rlrinpn(ary juiMio ^clinoh of (’iiieiimali. NinoLy- 
niiio per crnl of flic i liil'lrcii were Imrii, 70 i)(*r rent Jowinli, 27 

per Cent Were ?iMihdi*v«i 'li„ niid ^ per ci'iil wen* colored, llicir iLVoraf;c 
clirniU)lof;i<'!il II vcarii and N moiitliSf and Ihcir avciago mental 

according fo tin* ^ Miji (imiip Intelligence Syalc, Advanced Ivxainiiia- 
lioUj I'orin It, wa • 1 1 yi in,?. lie j'Mcii) ecoiuiinic hackRrouiKl was it hltlc 
below very high on llie Siinit »*^‘(:nre (aid. 

Tiie.si; 2K5 MiNtlcKr/ide cliildrcn were asked to lint all lliingH wliicli 
annoy, irrifide, and linfliei* llu*in, '1 Ik' itcinn wiae classified niulcr Hooial 
rcl(Uionalii|i:i, liealtli and appi^aiaiici*, home ami family, school; hobbies 
and iuler(*sts, fnoila, iieiiaiiiid eondiiel, gam(*s and aimiKcnienlS; foarSj 
inconveniences and aniMiyanees, aiiiuials and inseetss, and cuviummenta 
conililion.H. 

The following year I he iiinterial was |irestmlcil to the 28ii fiixt i-gia( o 
children of the l aaie seloiols, fliviciiticd uhrive. The niutorial, in the 
of separate teslsS for hoys and girl.s, provided for live dilTereut degrees of 
feeling toward every item listed. These w(?re Itkcy don t mind, don I 'c, 
haic^ ainl hnlv much. T he eliildreii wen‘ asked to eneiiclc the cxprcaaion 
that best (h'S(!rihcd their feeling toward eadi item ILstcd. The material 
wus tiibnliited, elmnged lo per ciaiLs, and arranged according to frequency 

for hole much, . . 

This ])aper is a report of llm ileins elasHifnal niider social rolationslnpa, 

Iionui and fiunily, .school, and personal eondiict. 

Allitudc-s of Hoys 

Tiiblf! 1 lists soi'iiil siluuliniiH lliaL (im lumoyini' (don’t like, Imtc, and 
hate iniieh) to 05 per cent of the l)oyH studied. Ihcy tuo eapccia y 

7G 
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Tabic 1 

Attitudes of 146 Boya Toward Social Situations 


Item 

Per Cent 
Who Marked 
*'Hato Much” 

Item 

Per Cent 
AVho Marked 
'UlatQ Much*' 

Bb blfinied for something I 


To fco slapped 

34 

didn't do 

60 

To bo ridiculed 

33 

People who ohent 

69 

Sarcastic remarks 

33 

Unfair things 

60 

Two against ono 

28 

A bully 

66 

People who talk too much 

28 

War 

60 

Ugly people 

20 

Hftvo people angry at me 

61 

See girls net grown up 

20 

To lose BOTneone'B things 

46 

See people crying 

2Q 

To ho poor 

45 

Hear talk on solf-control 

24 

People who show o£t 

44 

To borrow money 

22 

A sisay 

44 

Old maids 

22 

People who tell lies 

43 

People who talk too foat 

22 

People who laugh when I 


People who talk too slowly 

21 

get hurt 

43 

To fight 

19 

People who always argue 

40 

Long veligioUB sermons 

18 

Stupid people 

40 

To be alono 

18 

To lose in a fight 

37 

People on diets 

14 

To fight little boya 

37 

To talk on telephone 

13 

A mean peison 

37 

Certain boys 

13 

To get into trouble 

37 

Certain girls 

13 

Tattletales 

35 

People who not funny 

12 


The average diatribution for ail items, in terms of per cent, waa: Like 10, PonH 
mind 19> Don't like 21, Hate TT, and Hate much 27., 


disturbed when blamed for something they did not do and by people who 
eheet^ unfair things, a bully, and war. They do not like to have people 
angry at them, to lose someoae^s things, or to be poor. People who talk 
too much, who lie or argue, who are stupid, mean or sarcastic, who laugh 
when others get hurt are very much disliked by the boys. Sissies, show- 
offs, or tattletales rate low with these boys. They do not like to lose 
in a fight or to fight with little boys, to get into trouble, to be ridiculed, 
or to be slapped. The boys vary in the number of situations that annoy 
them and in the degree to which they are annoyed.^ 

Table 2 gives home and family situations that are annoying to many 
boys. They dislike moat to get a whipping, eapecially for something thoy 
did not do, to be scolded, punished, or nagged. 

Some of the boys do not like to do various chores around the house, 
run errands, or take care of smaller siblings. 

^Roae Zeligs, Tho relationship of emotioniil and powonality traits to learning in 
children (unpublished Dootor^s dl^eriatioii, Univerfliby of Cincinnati, 1037), 
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Table 2 


AUUnilc\H (if M5 T 

lavard Iloino and Family 


VVT ( Vllt 
WlJM Mwrkr^l 
Item "HnU^Mucir 

Item 

Per Cent 
Who Marked 
“Itato Mueb'^ 

To get n. wI»ifP|)iriK (tirminn- 


To wft^h and dry dislica 

13 

ihinp I iVMl do 

r,2 

To awcop Hoorrt 

13 

To gel ft wldpjun^^ 

r>(i 

To wmih tli« bathtub 

13 

To bo ecolilcd 


To work arouad LIki Iiouho 

13 

Let brother break iny gaiuea 

:i(i 

To go to lied lute 

12 

To be jMiiifHlied 


To (liiHt niniiiiiro 

12 

To bo nQggftd 

;iri 

To Ret the table 

12 

To clcftn llic cellar 

23 

To fight with brother 

10 

To BQW 

2\ 

To ckftu gold-fis\i bowl 

10 

To wftil ia store while inolbor 


To cook 

10 

shops 

20 

To go (o tfio fltoro 

10 

My Bialcr'a 

\H 

To lake euro of bouse 

0 

To go to bed early 

1(1 

To Hbovel enow 

0 

To scrub 

1(1 

To go lo bod 

0 

To olcnn the boufto 

M 

To rake the yard 

8 

To tftko c/iro of 

13 

To run erraiKls 

Q 


The nveraKO (liAlrihiitiuii for nil iUttnn, in (onus of per ceiil, wiih: Like 23i T)on’t 
mind 33, Don’t like ]|), linfo ] I, niid Ilnlo 17. 


Table :i 


Attitiifle 

fl <pf HT) Hoys Toward iSrhool iSltuftlions 


Item 

IV C'onl 
Who Marked 
“Hale Much” 

Uetn 

Per Cent 
Who Mnrkefl 
“llaloMncb" 

To get low marks 

4[) 

Tx) go to Sunday School 

13 

(]crtftin teaebt^rfl- 

10 

To do nighlwork 

13 

Teachers who have pets 

30 

have Lo iniss achoul 

12 

Do sent lo prlneii>jil 

30 

T'o writo book reporU 

11 

To hoar teachers i)rcach 

30 

To study griiminar 

11 

Teachers who dlsliko me 

3(1 

To go to ffchool 

0 

lY riling lesHons 

23 

To give talks 

0 

To memorizo poem a 

21 

To iiludy lniit{>ry 

a 

lligli Hinging 

IH 

To read iiiy coiiipositionH 

7 

To wrile comp osil loan 

17 

To lake jirt 

7 

Singing in school 

J'J 

'l“o lakf,‘ teslo 

0 

Arithmetic 

i;j 

To study gcogrupliy 

d 


The nverngo diHtriliiilion for nil ilcniH, in Uirum of pur cent, \vi\a; bike 3-1, Don’t 
mind 27, Don't like M. Ilnlc 1), niul llnlo imieli 1(1. 
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Though mtiny school contacts nve cnjoyctl by the boyS) it enn be Been 
from Table 3 that the boys dislike most to get low marks, certain teachers, 
teachers who have pets, who preach, or who do not like them, and to be 
sent to the principal. Almost 20 per cent of the boys hate or hate much 
to go to school while 40 per cant of them have that same reaction towards 
Sunday School. Writing and singing lessons represent the leasl-Ukcd 
subjects, while manual training and gymnasium work nro tho favorite 
subjects. 

Table 4 lists the boys’ attitudes toward personal conduct. Heading 
the list are character and personality qualities. To curse, tell lies, or bo 


Table 4 

Mtitudes of U5 Boya Toward Pcraonal Conduct 


Item 

Per Cant 
Who Marked 
"Kata Much'' 

Item 

Per Conb 
Who Marked 
"I Into Muck" 

To curse 

67 

To break windowe 

38 

To bell lies 

62 

To brag 

36 

To be stupid 

Bl 

To got angry 

32 

To be BDDiJsed of lying 

51 

To lose in a bull gnmo 

30 

A guilty CDioficiencQ 

47 

To lose in any gnmo 

28 

To lose money 

40 

To ImrbflomeonQ 

28 

To cry 

45 

To loflo In card games 

26 

To lose Q fountain pen 

46 

To lose in marblca 

25 

To bite my nails 

41 

To attract attention 

18 

To logo anything 

41 

To kiss peoplo 

15 

To hm bad habits 

38 

To be still 

12 


T^he average distribution for all jkBina, in terms of per cont, waa: Like 4, Don’t 
mind 13, Don't like 25, Hate 22, and Hflt« much 36, 


accused of lying and to have a g;uilty conscience or bad liabita arc greatly 
disliked. Other annoying Bituations involve the loas of money, fountain 
pen, or other possesaions, or to lose in games. 

Attitudes of Girls 

Girls express annoyance to a greater number of situations and to a 
greater degree than do the boys. Table 5 contains many more items 
showing girla^ dislikes in social situations than arc found in Table 1 for 
boys. Most disturbmg to the girls is to witness pain and suffering, people 
getting killed, sickness and death. Social relationships that rc8ulb in 
lowering their dignity or personal status are very annoying to tho givla. 
These include being accused of something they did not do, or of lying, 
being called a cheater, made fun of, treated like a baby, called names, 
scolded, or called a poor sport. 
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Table fi 

AUihule of MO (lirlu Toward Socml Siliialinufl 


I’er C’rni 
Who MnrkiMl 
Item '*lliite Miirh" 

Per Cent 
Who Marked 
It4?in "Hate Much” 

See pcoi)lo getting killcf) 

(iS 

A bltde joke 

30 

Bo acoviiird of HorimthiiiK I 


Croncliy diiUlren 

30 

didn't do 

m 

Hcinsh people 

30 

Bo cnllod a cheater 

(11 

lie bothered when reading 

35 

Sco people HnHor 

r>(i 

(2uarrol with boy friend 

35 

Bo treated like n buhy 

1)0 

(Biildrcii acting babyish 

33 

Bo mado fun of 

bf) 

When friciuls net foolish 

33 

llci\r Bomaiine lirm du'd 

53 

People who talk too much 

33 

Be called imiucjj 

51 

People who don't like to do 


Do Hcoldcd 

50 

anything 

33 

Do botlicrcd or pestered 

50 

A dull party 

32 

A bully 

48 

People who gossip 

32 

Pcoplo who arc fakers 

48 

To loEie ill a gnino 

32 

To 6 C 0 Bomcono nick 

48 

Thoughtless people 

32 

To be called a poor sport 

48 

Pl/iy with soincaiio 1 don't 


To 1)0 nccuHcd of lying 

48 

like 

31 

Asaooiuto with diiLy people 

47 

Not to go to parties 

31 

Pooplo wlio lio 

47 

People wiio talk in movies 

31 

Nasty pcoiilo 

47 

To ho Leased 

31 

People minding iny huainm 

40 

ViHits to boring people 

31 

JcftlouH people 

40 

He teiLScd about boy friend 

28 

A dry flpccch 

4C 

Discourteous children 

27 

To bo cinbnrrrusHcd 

45 

Silly people 

27 

To flcc ti cliild whipped 

45 

To /iglit 

20 

Siflsica 

44 

To got angry nt someone 

25 

Children who eheat 

43 

To ba patronized 

24 

An iiiitruo friend 

43 

Smart person acting U\imb 

23 

To bo iiiBuUcd 

43 

People who arc cros-s 

23 

To play with menu children 

43 

Not to go to (lancing school 

23 

Constant nagging 

43 

People who arc rough 

23 

Sec people biting llicir imils 

43 

Pemisting people 

22 

Conceited people 

42 

To be diaappointed 

22 

Stubborn people 

40 

Kisaing games at parties 

21 

Have privilegGH taken away 

40 

To pay full car fare 

22 

People who arc pests 

40 

To viait nick adults 

20 

People wlio hrag 

40 

Talk about self control 

20 

When friciids getaick 

40 

Boys who make love to mo 

19 

Sec a ori[)]ilo(l poi BUT) 

30 

Talk long on one Hubjcct 

19 

See children show olT 

30 

To take revenge 

18 

Sloi)py people 

38 

People who act funny 

17 

A hairy actor 

38 

Ilnvo big reaponsibilitics 

10 

Stupid people 

37 

To talk long on phone 

15 

To be yelled at 

30 




Tho average distribution for nil itcmB, in terms of per cent, was: Like Id, Don't 
mind 14, Don't like 20, Hate 22, Hate much 30. 
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Most of the girla express extreme dislike for antisocial people such 
aa those who lie, mind other people’s business, arc jealous ami nasty. 
They don’t like sissies, ghildrcti who cheat, and an untrue friend. I’cr- 
sonality traits annoying to the girls are conceit, 8tul)l)oriincs.s, .sloppines.s, 
grouchiness, foolishness, selfishuess, stupidity, and though tlc.ssncss. 
Constant nagging and teasing, visits from boring people, and individuals 
who bite their finger nails, talk in movies, and gossip arc disliked. In 
general, the prls reflect very definite standards of social eoudvict and nn 
unfavorable attitude toward those who do not live up to those standards. 

Also, in their attitudes toward homo and family the girls reflect 
standards of family relationships. As seen in Table G, practically all the 


Table 6 

Attitudes of 140 Girls Toward Home snd Family 


Item 

Per Cent 
Who Marked 
'^HateMuch' 

Item 

Per Cent 
W)io Marked 
^qinto Much" 

Make parents unhappy 

64 

Not to see rolativca 

21 

A Bpanking 

52 

To >Ynah and iron olothca 

20 

To irritate my mother 

60 

To ho bothered by sister 

20 

When mother is angry 

41 

To acrub 

10 

To be punished 

41 

To stockings 

12 

To be scolded 

37 

To wash dishes 

12 

To stay home on Sunday 

36 

To dust furnitwro 

11 

A dirty yard 

36 

To make bods 

a 

To see little brother ciry 

31 

My sistoPs singing 

10 

To ha\e my things bothered 28 

To BTVeep 

0 

Not to help mother 

24 

To darn socks 

0 

When mother won’t buy 


To go to bod Iftto 

0 

things I want 

23 

To clean tlic house 

1 

To he bothered by brother 

22 




Tho average distribution for all items, in terms of per eetU, was; Like 20, Don’t 
mmd 24j like 18j Hate 14, and Hate much 18. 


girls dislike to make tlveir parents unhappy or angry, to be punislied or 
flcolded. Though they do not like to be pestered by siblinga, most of the 
girla like their little sisters and brothers and do not mind taking care of 
them. Practically all the girls like babies. Some of them dislike house- 
wort, but very few girls dislike company or going out on Sunday. 

Aa shown in. Table 7^ maladjustment in school is displeasing to the 
girls. They are extremely disturbed by bad report marks, unsatisfactory 
lessons, or poor conduct in school, especially if these require their mothera 
to come to school. They do not like teachers who got angry, scold, or 
give long lectures, or fail to mark papers. Writing lessons are liked least 
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Table 7 

of 140 (lirlfl Toward School Siluationa 



Per Cent 


Per Cent 

Item 

Wlio Marked 


Who Marked 

'Tlato Mvieh’’ 

Item 

* 'Hate Much" 

Had rcfport marks 

58 

Writing Jcfi.40iia 

21 

When ni other luiH lo com© 


To hnvo night Work to do 

21 

to Bchool 

dO 

Tcaehcra who don't mark 


Not to know my lesson 

30 

papers 

10 

To bo bad in Bcbrnd 

311 

To diaeAma poems 

18 

Not to liave my homework 

34 

To cojiy tliinge over 

18 

To make Lcaclicr angry 

33 

To memorizo poctna 

18 

When I can’t answer a (lucation 33 

To make book reports 

17 

To get nervous in a teat 

31 

To go to Sunday School 

13 

Too much night work 

30 

To carry books 

13 

To do Imrd Icsaons 

27 

To study 

13 

Long lectured by tcacljera 

25 

To havo teats 

11 

To talk out in flchool 

24 

Certain teachers 

11 

TcacUcra who scold 

23 

To have school over 

10 

To mcinorizo lossons 

22 

To write compositions 

0 

To stay homo from rcUooI 

22 

Grammar 

Q 

Tho average dittlrihution Cor ull items, in tenim of per cent, was: 
Tnliid 23, Don't like 17, Hate 10, and Hate much 10. 

Like 20, Don’t 

of all the subjects, while gymnasium work, spelling, drawing, and gcog- 

mphy arc liked mo.st. 




Antisocial cfiaractor aiui personality traits (Table 8), as expressed in 

their personal conduct, 

are annoying to tho girls. Telling lies, being 

bad, moan, or unreliable, doing wrong, or getting into trouble are marked 


Tabic 8 


Attitudes of 140 Girls Toward Personal Conduct 



Per Cent 


Per Cent 


Who Marked 


Who Marked 

Item 

"Iliite Miicli" 

Item 

‘TIate Much” 

To havo had habits 

68 

To make plana and drop 


To tell lies 

55 

them 

34 

To bito fingernails 

53 

When I do wrong 

31 

To hu bful 

51 

To forget thiv^ga 

28 

To be mean 

51 

To ait in perfect siloiicc 

23 

To be unrcliablo 

51 

A HoU-coiiamoUB feeling 

21 

To get in troiililo 

42 

Wlicn I can't do iih f like 

10 

To bo idle or lazy 

37 

Alwayfl to want bhinga 

15 

To do somoLhing I don't like 

3G 

To ait Htill 

14 


Tho avcrfigG diatribution for all itcme, in terms of per cent, wna: Like 11, Doi/t 
mind 12, DoiiH like 21, Hnto 23, and Hate much 33. 
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hate ov hale much by mosL of the gii-ls. Also liftvini; bful lialiit.s, bitinK 
finger nails, or being hty and forgetful receive the; disiiinnoval of nmny 
girls. 

Sex Differences 

A oompariaon of the sexes in relation to iinnoyan(!(;.s i>n 102 items 
listed by both groups indicates that girla arc amioyed by nuue factors 
than boys and also that they react to a greater ih'gree tlmn tin; lioys do 
to those annoyances. This is e.speci!illy true in irdation to imnsonal 
conduct, Significant acx difference, s show greaUu- (li.^lilfc; Ijy boy.s of 
people who cheat. They arc much more rc.sentful tluiii the girls of not 
being able to do as they like. In school, .signilicautly more bt)y.s dislike 
arithmetic and singing, while more girls do not like to have nigktwork 
to do, More boys do not like to sew or to hear their si.sters sing. Sig- 
nificantly more girls hate to bite their finger nails. 

Summary 

A study of children’s renctiona to annoyance.s occurriuR In social 
relationships, home and family, school, and personal conduct indicates 
that many situations are extremely annoying to twolvc-year-old clnldrou. 
Girls are more often and more extremely annoyed tlmn bny.s, 

Ediicalional Implicalions, An annoyance i.s on unfaA'orublc attitude 
which in many cases is caught from ohliej's. fjomo of tlu; Uoin.s lisletl 
should not be annoying to the normal cliild. People who are coiwlanlly 
irritated by every little thing reflect a failure to adjust to their environ- 
ment. “They can’t take it.’’ On the other hand, a glance at many of 
the items listed in the tables suggests definite social Htanduvils whicli 
have been accepted by the children. Being annoyed by anti.social con- 
duct reveals the acceptance of favorable group attitude.^ and leads to 
adaptation to the social group. But when children respond unfavorably 
to many unimportant situations, they should be taught to ignore those 
factors and not be disturbed by them. However, we should avoid as 
much as possible constant and unnecessary irritation. Thi.s i.s vi tnl in a 
time when the human organism is being worn out by many indtation."), 
fears, and worries. 

Jiecevuei /anuorj/ JO, 19 ^, 



A School Survey of Eye-Hand Dominance 

Gertrude Ilildrctii 

llnrarr Srhiml, dotumbia UnivcnHy 

Tlifi liHinf iH wii|("i)ir('u<l Unit mixed I'ye-liniiil doininiinrp., lliixl Ih, llic londcncy for 
oyc iiiid liniid prcfereiice 1o liii o|i|M>Mii.i' ni(lrd, Ih u cmiiioof reiulinf; diHaliilil-y, nervoMs- 
iifjjs niid liph(\v'iiir linddeiiiH. The riKlil-himdcd I'liild wlio i# IcfL-eyctl or vico verm is 
ohmniiPd to liitvo luorit diflinilty in leuniiiiR lo read niid in nmkitip; Knlinractory personni 
ndju.slnicnt'n, lie in lirlinved to niirnir write more Uiitn llic individual wlioiic cyo and 
liimd (I((iniimm’« nro liku-'iidcd. A pnrcrit recently inquired, "Isn’t my child's rending 
diflii'.ully dun to tlie fact tlmt tesla show hIic is left-eyed?'' The notion is also prevalent 
tliat raised oyn-lnind <loiniiinncc ia ii rare, occurrcnec in the general population, 

A nuinhcr of luddiHlied slndies have given Hrmicwhul conflicting results, The present 
sliidy WU9 undertaken to olitaiu midilioiiiil evidence on the subject, to determine tiro 
incidence of mixed dominance in an entire Ldcmcntary aclitrol popiiiation and the nsno- 
clation between tnixcrl dotnitmuco arid reading disability in the Hftttio population. 

lioKiillH of rt'ovioiiH Sludica 

IncidtincR of LrJt-IHycdufiat and Mixed Dominance. Ptu',son (8) re- 
porlcfl HO |)or ermb l(![l-r!y(!(ln(;.sH, V2 jier cent irnpartinl, anti 58 per cent 
vight-cycdncHa in a nui'Muil hoIiouI population in which left-handedness 
waa prcHont in ahonl four per eent of the caises. Seizor (10) found 32 
per cent of OO children in the (latubridfic schools, Grades II to VI, to be 
left-eyed; 72 ])ei' cent of the left-handed children were IcfUeyed. Schonell 
(9) invcstlfralcd the relation between eye and hand dominance in 75 
school children, with the followiiifi results (R.II. and R.E. signify right 
hand and right eye Vesiiectivoly) : R.II. — R.E., C0%; R.H. — L.E., 25%; 
L.II.— L,E., 4%; L.II.— R.IC., 3%; R.H.— and either eye, 8%; and 
L.H. — and either eye, 0. 

Mixed Dominance and Reading Disability. Johnson O’Connor (7) 
reported an unusual amount of uncoordinated motion, twitching, shifting 
of position, spcocli irrcgularilics and rending troubles among those who 
tested left-eyed and right-hnndccl. He found kss trouble among those 
whoso handcdnc.sH and eyediic-ss agreed, A study by Mintz (5) indicated 
more mixed domiuanoo among .subnormal than among noinnal children. 
Monroti ((}) rejun'led that -13 per cent of the reading di.sabiliiy cases she 
studied Allowed mixed dominance. I'crnald (1) reports on the problem 
as follow, s: "The righHandcd cimca and the cases of matched eye-hand 
dominance resemble the cases in which the dominance is not matched, 
are as serious in their dcliciency, learn by the same methods, and are as 
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successful in tie final outcome. The mibiect with unmatched eye 

and hand dominance learna to read and is able to read in an entirely 
normal mannev wtli eye and hand dominance still opponite. ' Gates 
and Bond (2) found little association between eyeclncss, handedness and 
reading achievement. Johnson (4) reported no significant relationship 
between lateral dominance and reading disability* Wile (11) found 
among children showing reading disability, 02 per cent left-eyed, 8 per 
cent uncertain or mixed, 30 per cent right dominant- There is no indi- 
cation as to how many of these pupils were Ieft-I\anded. Witty and 
Kopel (12) found 33 per cent left-eyed in a group of poor readers, 31 
per cent leftreyed in the normal reading, iion-problGin group. Wolfe (13) 
reported that more normal readers than retarded showed dominant left- 
eyedness on a sighting teat and the groups were found not to bo dis- 
tinguished by handedness or a combination of oye-liancl dominance. 
However, the retarded proved to be inferior in auditory f unctions, visual 
perception and emotional adjustment* 

A School Survey 

New evidence on the question was obtained through surveying an 
elementary school population consisting of 101 boys and 90 girls from 
kindergarten through Grade VI. The ago range was from 6 to 11 with 
two children who lacked a month of being 6 and two who had just turned 
12. The population rated above the average in general ability a9 meas- 
ured by standard tests, Because of the selected nature of the population 
there were no cases in Which reading disability could be attributed to 
lack of ^earning capacity, 

Tesis of Eye and Hand Dommance. Each pupil waa given individual 
teats of eye and hand dominance, Four tests of eye dominance were 
used as follows: 

1, Sighting dot. The child^a attention was called to a black dot on a card 
taoked on the wall. He was told to stand with toes on a line marked on the 
floor three feet from the walk The dot waa placed at eye lG\el. The child 
was given a box lid in the center of which was a half inch hole, He wna naked 
to hold the hole at arms' length with both hands, be was told that one oyo 
would be covered, then the other and that the dot would probably disappear 
when one eye was covered. The examiner covered each eye in turn, with a 
small card, asking the child to state whether he could or could not still sco tUo 
dot. The eye with which he could still see the dot when one eye was covered 
was recorded as the dominant eye. 

2. SxghHng ivith the Parson manDploscopc, T)ie cliild was asked to stand 
on a line two feet from the wall where the Parson board with red ball in be- 
tween the letters L and R waa hung up at the right height for hie aizo. He 
Wfts given the ftluminum cone, was instructed to hold it in both hands, his 
attention was called to the red ball and he waa inatructed to fixate the red ball 
as ho looked through the cone. Then the examiner explained that one letter 
could be seen alongside tho ball, and the child was asked to state what letter 



A iScliool Suruci/ of Eye-Hand Dominance 


85 

lie could SCO. Tliifi letter wiia recorded. For the youngest children, small 
pictures of a dog and cat were used in plnco of the letters L and U. 

3. Siohiing dot with the Parson com. The child standing two feet from a 
card with a black dot held by the examiner, was asked to fixate the dot through 
tlie aluminum cone. The position of the aperture of the cone with reference 
fco an imaginary vertical line druAvn through the cliilcFs nose was recorded. 
If to the right of the imaginary line, the child was recorded aa righfc^cyed; if 
to the left, left-oyed, 

4* Peep Show. The child was nhowii an imitation Easter egg with pictures 
inside that could l>e seen by looking through a quarter inch a])crture at the 
amallcr end of the egg. The examiner held the egg iii both hands while the 
child studied and rci)ortcd on the picture. The eye used in fixating the pic- 
ture was recorded as the dominant eye. 

A test was repeated if for any reason results were not clear cut. In the 
first tliree, the child kept both eyes open. 

Only the fourth test in which the examiner rather than the child held the 
materials could bo said to bo entirely independent of handedness influence. 

Determination of dominant oyedneHa was more diflioult and probably leas 
Teliai)le in the case of younger children because of their difficulty in complying 
with instructions and their concern with irrelevant features of the test situation, 

Testa of Handedness. Handeilness was tested in three ways: 

1. The child was requested to pick up a pair of scissors and to cut a corner 
from a piece of paper. 

2. He was asked to write his name on the paper. 

3. He was asked to pick up and toss a ball to the oxammoT several times , 

These three tests afford a sampling of single handedness activities rather 

than a complete eurvoy of each pupil's handedness habits, 


Table 1 

Ilcsults of Eye and Hand Dominance Teats in an Elomontary School Population 





Eycdncaa 




Handedness 


Total 

Ago Level 

4R 

4L 

311 

3L 

2II-2L 

3R 

3L 

2R 

2L 

Cages 

6-6 Years 
Number 

10 

8 

2 

2 

2 

20 

2 

1 

1 

24 

Per Cent 

42 

33 

8.3 

8.3 

8.3 

83.3 

8.3 

4.2 

4.2 


7 Yearn 
Number 

13 

6 

3 

2 

2 

22 

1 

1 

2 

26 

Per Cent 

60 

23 

11.6 

7.7 

7,7 

86 

3.8 

3.8 

7.7 


8 Years 
Number 

10 

10 

1 

2 


20 

3 

2 

1 

32 

Per Cent 

60 

31 

3.1 

0.2 

— 

81 

0,4 

6.2 

3.1 


0 Years 
Number 

14 

0 


1 

3 

26 

1 




27 

Per Cent 

62 

33i 

— 

3.7 

11.1 

06.3 

3.7 

— 

— 


10 Years 
Number 

27 

8 

4 

2 

1 

34 

4 



4 

42 

For Cent 

04 

10 

9.6 

4.B 

2.4 

81 

0.6 

— 

9.5 


11 Years 
Number 

12 

16 

3 

6 

5 

36 

2 

1 

1 

40 

Per Cent 

30 

37.5 

7.6 

12.6 

12.6 

00 

6.0 

2,B 

2.5 
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Indications of Reading Achievement. Objcctivo (icst icaonlH, for the most 
part Stanford Achievement reading scores, or comparable data, were available 
for each pupil. Those who scored a year or more below grade median in the 
primary grades, a year and a Imlf or more in the upper gmilea were considered 
disability cases for purposes of this study. Teachers' estimates and the neces- 
sity for recent remedial instruction in rending eci'vcd as nd<litional criteria in 
selecting the poorest readers in each claas. 

Results 

Table 1 shows the number and percentage of pupils in each ago level 
who were totally or partially right- or left-eyed, totally or partially 
Tight" or left-handed on the seven tests given. The riglil^eyed children 

Table 2 

Reaulta of Eye and Hand Dominance Teals showing the Rolationship boLwcon 
Eye and Hand Doininnnco 


Age Level 

Mited Eyg'IIand Dominance 

R.H.-L.E. L,H,-E.E. R.H.-R,B. 

LJL-L.E. 

5-6 Years 





Number 

1 

1 

11 

2 

Total nmnhar mixed 

8 




Total per cent mixed 

33.3 




7 Years 





Number 

8 

3 

14 


Total number mixed 

U 




Total per cent mixed 

42 




8 Years* 





Number 

8 

1 

20 

2 

Totol number mixed 

0 




Total per cent mixed 

28 




0 Years 





Number 

0 

^ 

14 

1 

Total mimber mixed 

D 




Total per cent mixed 

33.3 




10 Years 





Number 

7 

3 

27 

4 

Total number mixed 

10 




Total per coat mixed 

24 




11 Years 





Number 

20 

3 

12 


Total number mixed 

23 




Total per cent mixed 

57,5 




Per c enb mixed all age 





levela combined: 

30.0 





The record for thO only pair of fcwiua: 



-Eyednesa Tesla 

Handedness Tesla 



1 2 

3 4 

12 3 


Girl 

R R 

R R 

R R a 


Boy 

L L 

L L 

R a R 
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wero more coiiHintently riRhfc-eyed in the four eyedneaa teats than, were 
the Icft-cycfl cliildren. It was rnthcr Burprising to find a substantial 
number of tlic rij/iZ-cycd children writing with the left hand 

Tlicro wnH no clear cut or consistent developmental tendency from 
one age group to the next. Sec Table 2. Although numerous researcli 
studies have ehown a decrease in rlomiuant Icft-hnndcdncss with age, 
and a fllight tendency toward decreasing left-hnndctlnca.B waa found in 
these results, no hjicIi decrease was shown in these data for eye-dominance. 


Table 3 

Eyo-IIfind Data, for tho Slowcat HBaders in Each Age Growp 


Ago Level 


Boys 



Girls 


Kyedneas Handcclncaa 


Eyeclness 

Handedness 

Tycftra 

Coflo 1 

4R 

3R 


— - 

— 


Cftao2 

4L 

3R 


— 

— 

8 years 

COBD 1 

4R 

3L 

Caso 1 

4L 

3R (foreign 







child) 


Case 2 

4R 

3R 

Caao 2 

4R 

3U 





Coso 3 

4L 

3R 

9yeor0 

CflJBO 1 

4L 

3R 

Caeo X 

4R 

aR 


Caao2 

4U 

311 





Caao3 

3L 

3R 




10 years 

Coao 1 

4b 

3L 

Coao 1 

4R 

3R 


Cose 2 

4b 

3R 
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In fact, the eleven-year group allowed an increase in left-eyedness over 
the ten-year group and more instability on the tests in general. The 
same situation did not prevail in the handedness test rcisults for the 
eleven-year group. This may be a chance result due to the small popu- 
lation or it may be an indication of instability appearing with the ap- 
proach of puberty. 

Eye-Hand Dominance and Reading Disahilily. Twenty-two ensea, 
sixteen boys and six girls in the entire group of 191, were selected aa 
reading disability coses, according to the criteria given above. These 
pupils were all seven years of age or older. Table 3 shows the results 
for each age level in terms of eye-hand dominance. 
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Of the boya, there were Bcvcn or 44 per cent of the cases who showed 
mixed eye-hand dominance; of the girls, three or 50 per cent wlio showed 
this condition, a total of 45 per cent or less than half of all imling ills- 
ability caacs. The mimber of cases is too small to indicate reliably that 
these reading disability cases showed more tendency toward mixed domi- 
nance than the normally snccessful readers. 

Although a somewhat larger proportion of mixed donihiaut cases had 
difficulty with reading than consistent dominant pupils, flince fewer than 
half the mixed dominants were slow in learning to roml, the conclusion 
must be drawn that mixed dominance is not a prevailing condition in 
reading disability, far less a dominant causal factor iu the majority of 
disability cases, 
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rifihn, Eugene F. Sluikrinq^ significant theories and therapies, Pnb 

AUo; Stanford University Press, 1943. Pp, ix H- 177. $2.00. 

Pr()fe.H3or Hahn ha.s presented a compendium of theories and therapies 
of 25 of the “nutltoritica in tlio field.” Ho does not state tlie basis for 
his selection of specialists, altliough tho list appears to be representative 
of the major educational and medical clinics doing research and thera- 
peutic work on stuttering in this country and abroad, and to suggest the 
great variety of ways in which the problem is studied and treated. Since 
the several reports average less than six pages each, they are necessarily 
sketchy and incomplete. The author’s purpose of facilitating compari- 
sons of tho philosophies and therapeutic procedures involved is inherently 
limited by this restriction. The careful student will want to go to origi- 
nal sources. The beginner moy be more confused than enlightened by 
the multiplicity of pointe of view presented. 

Bach summary is divided into sections on Theory and Therapy, 
While most speoialista appear to have been impelled to evolve a unique 
theory of stuttering, the careful reader Avill detect a considerable amount 
of similarity, under the verbiage, used to explain many Of the theories. 
Some are certainly much more closely in line with modern psychological 
thinking than others. One of the values of the theory is no doubt tho 
suggestion to the patient that the clinician is an expert. Anyone who 
has such a plausible explanation of tho difficulty would surely appeal to the 
afilieted as a desirable person to administer treatment or direct his study. 
TJiere is no indication that clinicians have consciously evolved their 
theories for this purpose. The multiplicity of theories is suggestive of 
the early reports to The French Academy of Sciences on the origin of 
language. 

The Sections on Therapy appear to this reviewer as more significant. 
While few clinicians claim universal "cures” the success reported with 
such widely divergent treatmouts indicates either that stuttering is a 
malady of many causes and therefore subject to many treatments, or 
that there are common therapeutic values often overlooked in the various 
types of therapy, and not explained as such in the theory. 

An Appendix of fifteen pages prepared by the author and entitled 
"Procedures in a Clinic for Stutterers” is a gesture toward unification of 
the various points-of-view of the "specialists.” Within the limits of 
space used, this appears to be one of the better features of the book. 
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The book focuses attenfion on the gveat variety hackRvouwk awl 
approaches to the malady by tliosc who me “iiuHi(»rilh'a iu the (ield," 
and leaves the reader with the realimtion that there is slill much research 
to be done. If this book serves ns a stimuIuH to furllicr iTsnarcIi and 
unification of thinking in tlic field, it will make au imporlimt coutvilmtion, 
This reviewer does not believe that the book will serve as such a stimulus, 

Frmikliii II. Kiiowci' 

The Stale UnmTsii]/ of Iowa, 

DeparhnejU of Speech 

Cole, Luella» Aitamn{f malurity. New York: Narrar anJ Ilinelmrt, 
1944. Pp. X + 212. $2.00. 

Tliis treatise is coucevned with problems of adjuHlment in ilic modern 
world. Both in ordinary times and in times of there arc always 

individuals who cannot adjust to complexities of life, Smm of these 
never progress beyond childish attitudes and adolescent whims, Others 
regress to this status in trying timea. In other words, such people nevor 
grow up, i.e.j attain maturity. The mature individual in rolalivoly free, 
he finds contentment and he feels secure. After noting the need for 
maturity, the author dieeusses the criteria of intellectual, emotional, 
social, and moral maturity. Popular escape is by fniituwy, play, solilucle, 
fanaticism, projection, sophistication and illness. SolutioiiH for Lho ma- 
ture person are briefly outlined. The final section is conoornod with 
maturity and the war. The book contains many cnliglUoning examples. 
Both the case studies and the discussion arc well ovganWiOd Ui aid in iu\ 
analysis of acute problems of adjustment. Aa a guklobook for those 
seeking to attain maturity, however, the treatise is less adequate. There 
are a few ill-conBidered statements such as *‘thc mndhovisc yawns for 
those who cannot be emotionally toughened*^ in war situations. Never- 
theless the book hag much to recommend it as guide to living with 
yourself and other people,^' 

Miles A. Tinker 

The VniversUy of Minnesota 

Kingsley, Donald J. [Chairman], Recruiling applicants fOT the j)ublic 
senice, A reporl submiiled to the Civil Service Assembly by the Com- 
niitUe on Reerwiiing Applicants for the Public Sei vice. Chicago: Civil 
Service Assembly of the V, S, and Canada, 1942. Pp. xvi + 200. 
$3.00. 

This volume sponsored by the Civil Service Assembly of the U. S. 
and Canada is another in the aeries dealing with the major phases of 
puhiic personnel administration. The report is the work of J, Donald 
Kingsley aided by a committee eonsiating of Fred Zapolo, Ilussel Barthell, 
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Irving Gold, George C. Rrown, William Howell, George H. Halsey, and 
Edgar H, Young, among others. 

The treatment of the subject matter can be Hubsiimcd under four 
categories or topics embracing six chapters: (1) historical antecedents of 
public service recruitment, (2) the nature of recruitment and recruitment 
procediircH, (3) determining and forecasting personnel needs, and (4) 
application procedure and audit. 

The content of the report is sumnuiri^^ed as follows: Traditional con- 
cepts of recruitmont are inadeciuato ajul have generally failed to produce 
a meritorious public service. The assumption that **keeping the rascals 
out'' — a reaction to the spoils system — would of itself establish an ade- 
quate public service has been shown to be incorrect, and in fostering, a 
laissez faire attitude in regard to recruitment, has resulted in a failure to 
attract men of superior ability to the public Bervice. Recruitment should 
be positive in approach and should bo to the lower levels of integrated 
classes of positioiia with promotion to higher levels. Such recruitment 
should occur at an early age and the point of entry into the service should 
be related to the educational syatem. The institution of these prin- 
ciples coupled with flexible transfer and promotion would give rise to a 
career system attractive to men of ability. Assumptions of such a career 
system are that adequate techniques for attracting and selecting recruits 
are available, and that high prestige value exists for the puldic service. 

Recruitment is defined as ^Tlmt process through wliich suitable candi- 
dates are induced to compete for appointments to the public service." 
The first step in the process is the determination of present and future 
personnel needs as a basis for planning the recruitment schedule. Such 
forecasting reduces the need for provisional appointments and serves to 
coordinate the recruitment, selection, and certification programs, Per- 
eonnel needs may bo detennined from many source,s but among tlie most 
useful arc departmental demands for new personnel, personnel records 
and turnover statistics, analysis of departmental budgets, and surveys of 
employees for promotional possibilities. 

There are two kinds of recruitment: anticipatory and direct. The 
former consists of building up favorable attitudes toward the public 
service without regard to any particular examination but with an eye to 
remote recruitment; the latter is the specific scarcli and location of an 
adequate number of applicants lor a specific ex an h nation. 

Examination announcements arc employed in direct recruitment to 
attract and interest qualified persons in examinationsj to intorm them 
of the nature and conditions of employment, and to discourage unqualified 
persona fiom applying. However, examination announcements are not 
equally suited for these functions and should only be employed for indi- 
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viduala already interested in public employment. Where legal require- 
ments are not restrictive, examination publicity should be of a variegated 
nature and in line wth principlea of modern advertiBing. Announce- 
ments should be made more attractive and more care given to their 
distribution. 

Admission to competition is invariably by application. This process 
involves the congtruebion of an application form to Hocure the appropriate 
facts administration of the application^ determination whether mininiurn 
qualifications are met, and notification to the applicant of admission or 
rejection, The governing principle in application procedure is that only 
those items related to successful job performance, or statutory require- 
ments, should be contained in the application, and audited in a manner 
moat conducive to the determination of qualification or the lack of it. 

Principal deficiencies of current recruitment procedures are: (1) un- 
imaginative and stereotyped recruitment, (2) tendency to conform to 
legal minimaj (3) absence of objective information upon which to base a 
sound selection program, and (4) a lack of planning and basic reaeatch* 

The value of this report lies in its sound outline and treatment of the 
general problems of public service recruitment. It is not intended as a 
palliative iadicating how more nurses, accountants, or social workers may 
be recruited in the war emergency but rather presents a number of prin- 
ciples upon which an adequate recruitment program should be based. 
This seems a wise departure for it is doubtful at best whether any volume 
of this scope can solve the problem of recruitment without a basic vc- 
fonnulation of governmental and administrative policies. Although the 
report is by no means novel in its recommendations, following closely the 
earlier studies of Professor Kingsley and the Commission of Inquiry on 
Public Service Personnel, its reatatemeut is so fundamental as to make 
it mandatory reading. Nor does this detract from the excellent discus- 
sion of application procedure which comprises the second half of the book. 

Of specific merit is the stress placed upon the need for research and 
objective information regarding basic recruitment and selection prob- 
lems, The reiterated objections in tlie book to provisional or temporary 
appointments and the emphasis on forecasting of personnel needs as a 
corrective measure is wholesome. Of consequence also is the objection 
to long and involved application forms where the information requested 
has no relation to job success. Following industrial practice, applica- 
tions should contain only those items that are of predictive significance 
in. placement, in addition of course to those required by statute. 

It is the reviewer ^s opinion that the career system as a cure-all for 
the recruitment problems of governmental agencies has been overs tressed. 
Granting for the moraent the ciaaumptionB of prestige for the public 
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Bervice and adequate Bcle(}tion and recruitment tecliniques — by no means 
safe assumptions— liave not other factors been overlooked; c.g., compe- 
tition of industry, businesa, or the professions; opportunities for higher 
salaries or profits wliich public jurisdictions could not hope to meet; the 
fact that un unknown quantity of individuals may not be interested in 
a life career in one agency or locality. Attraction of individuals to 
employment is always based upon a complex of factors of which tiie 
opportunity for a career ia a variable weighted in varying degrees. 

There is furthermore something to be said for recruitment of special- 
ists at higher than the entrance level. Public jurisdictions are limited, 
and will remain limited by their very nature, in the scope and amount of 
training they can provide career neophytes in a large and varied number 
of occupations. Sucli training can usually be given only in professional 
and technical schools at considerable expense. Selection of numbers of 
recruits on the basis of appropriate aptitude may well be an insurmountr 
able task for such a diversity of aptitude teats do not exist and public 
personnel aptitude testing is even less advanced than subject matter or 
achievement testing, Nor can a probationary period substitute for 
inadequate eelectvoti. Thu concept of a career system ia laudable when 
due consideration is given related factors in recruitment. 

Arthur Burton 


CalifoniicL State Penonnel Board 
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The Role of the Psychologist in lyiarket and 
Advertising Research * 

Wallace H. Wulfeck 

The Federal Adoerlhing Agencyy Ztic,, Ne\j} York City 

Psychologists, genemlly, hare been trained for the work of the lab- 
oratory, clinic and classroom. These places have been their oconpa- 
tional milieu. With the exception of the few, who in late years have 
been working in the field of business and industry, not many are ac- 
quainted with the actual details, the scope, or the wide variety of interests 
which make up the business psyohologisW day. This paper will try to 
provide' an insight into these processes. It will (a) take a quick glance 
at the rapid expansion of psychology's contribution to industrial and 
business development during the past ten years; (h) make mention of 
some of the personalities who have played a part; (c) give a job descrip- 
tion by examples; along with (d) a predieUon of the plaee of psycho- 
logical research in the present and post-war economy. 

Much of the discussion will be centered around the work of the 
Research Director in an advertising agency. This presents no particular 
limitation becauee most agencies serve a rather large list of accounts, 
representing a broad sample of manufacturers. In our case, it runs from 
corsets to railroads and touching such products as food, drug sundries, 
cosmetics, clothing, sanitary protection, pencils, magazines, baby load, 
heavy industry, and the emergency recruitment of farm and food proceaa- 
ing labor. The agency research service reaches deeply into the areas of 
production, labor, and distribution of many of these clients as well as 
investigating their advertising problems. Consequently, agency research 
is in reality industrial and business research. 

We will not become involved here with the broad speculative prob- 
lems concerning the economic juatification of advertising, or the kind of 
politicabeconomic organization which should, or will, exist following this 
terrible catastrophe. We can only assume, as most politico-economic 

* Read at the February 1944 Meeting of tho "New York State Aeaociatlon for Applied 
Psychology* 
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prognoaticationa auggeat, that there v^iU be no fundamental change in the 
industrial organization oi this country except perhaps for a continued 
exercise of limited governmental control over the practices of business 
and industry. One needs only to read Stuart Chase: Where's the money 
coming Sromf ' to realize the kind of a ^vorld ^vc will live in and the 
collossai obligation of a controlled capitalism to maintain economic 
seourity for ^'We The People.'" It ig the continued existence of this kind 
of a ^vorld which provides the occupational challcrigo for pHycliologistg 
now and tomorrow. 

The date at which applied psychology first gained a dawning recog- 
nition ia debatable. For convenience, it may be placed around lOlfi-'lG 
when Porter began publication of the Jottmal of Applied Psychology, or 
more specifically with the pioneering work of such men as Harlow Gale, 
Hugo Muenaterberg, H. L. HoHingworth, E. K. Strong, and W, D. Scott. 
However, ita great commercial impetus came much later in the buaineas 
field following the developmental and promotional work of Link, Starch, 
and Gallup, among others. These men refined and expanded the now 
powerful methods known as marketing, publio opinion and advertiaing 
measurement which have become useful tools in a wide field of aocio- 
psychological, economic and military enterprises. Perhaps it is fair to 
say that by 1933 these methods and the national organizations to employ 
them effectively were reasonably well esfcablighod. 

The wide-spread acceptance of these and related methods has come 
only within the past ten years. In that brief span the growth has been 
phenomenal. The men and women recruited for this work came to it 
from many varied backgrounds and traimng. Almost aono of them had 
training or experience in buaineas, radio, or advertiaing. They brought 
to it one important element for auccegs and that was a training grounded 
in scientific method, and a belief in ita usefulness for solving the peculiar 
problems of business so far removed from the interests of the laboratory, 
Often they entered this field with grave misgivinge, ag though these fields 
of work were not a valuable or essential part of the life of our times, or 
would not allow uninfluenced freedom or scientific honesty in research. 
Notwithstanding, they came. Today the list of these people ia formidable. 

Who They Are 

Here are a few of them taken from the membership lists of the A.P. A. 
and A.A.A.P. This list la by no means complete, and no one has been 
omitted with intent. A fairly large group have found their way into the 
Bfirvicea. There are two who have the M.A. degree, the rest hold the 
Ph,D. 

i Nev 7 York, 1^43, The Twentiolih Contury Fund. 
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In Advertising Agency Research. George Gallup and Sam Hayes of 
Young and Bubicam, Otto Tinkelpangh of J. M. Mathea Co., John B. 
Watson of Esty Co., Albert Blankenship of N. W. Ayer, Ernst Dicliter 
of J. Sterling Getchell (now in radio), Alfred B. Root, and A. C. Welsh 
of Knox Reevea, Jean Pasmanticr and W. IL Wulfeck of the Federal 
Advertieing Agency, 

With Independent Research Organizations, P. S. Achillea, Henry C. 
Link, Albert D. Freiberg, George Bennett, P. C. Corby, Eleanor Barnes 
of The Psychological Corporation; Daniel Starch of Daniel Starch Asso- 
ciates; Raymond Franzen and George Gallup of the Institute of Public 
Opinion, 

Doing Radio Research. Frank Stanton, Ernst Diehter of the Colum- 
bia, Broadcasting Company; Matthew Chappell with G. E. Hooper; 
Sidney Roalow, The Pulse of Now York; Paul Lazarsfcld, and Robert H. 
McMurray. 

In Government. Renais Likert, and others. 

Consultants. There is an important group of business, media, and 
radio research men holding faculty positions, among them D. B. Lucas 
and John Dollard, Readership; John Peatman, Radio; Hadley Cantril 
and Harry H. Field, Public Opinion; Arthur Kornhauser ond Floyd 
Ruch, Marketing and Advertising; Harold E. Burtt and Howard P. 
Longataff, Advertising. 

It will bo noted that two of those named are women recently come to 
this field. The work is widc-open to women having the interest, training, 
and personality for it. 

Among business resenreh leaders, psychologists tend to predominate 
as a professional group, but there are men from many other scientific 
disciplines holding prominent positions. They include economists, engi- 
neers, Bociologista, and ©von chemists, Yes, psychology has made a 
place for itself in these fields even though it has failed to hold a dominant 
position in industrial and personnel work. Apropos of this last remark, 
it must be said in all fairness that the recently developed clinical ap- 
proach to employment and personnel problems has stimulated new 
interest on the part of management, which may change the stutus of 
psyohologiats in industry. 

If they arc not iilreiidy obvious, the reasons why psychologists enter 
the buBmes.s rcBcareh field wo similar to those for doing any kind of 
clinical or experimental work, 

1, As you will Hcu, the problems are inherently interesting in them- 
selves, as interesting ns many rei)ortcd in the uurrent psycliological 
literature. 

2. Often the results have important economic, political or social value, 
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3. The rewards to tlie individual in aatisfiiction, recognition, nnd 
remuneration iire equal to, if not greater than, those which accrue from 
work in other fields of psychological endeavor, 

If you are to get a ''reel” for the kinds of things tliese pcojjlo do, the 
types of problems they attack, the scope of their operations, wg can do 
no better than examine in outline a few of the projects stuiHed by the 
leseatch department of one agency during the pant year. TIicho prob- 
lems ate specific and representative and by no means exhaust the possi- 
bilities. Nor do they do more than indicate the ramifications of research 
in radio, marketing, and public opinion fields. 

Examples of Jobs Done 

First, it is well to know how the work is broken down into functional 
operations. There are three related types of investigation: 

1, The application of psyohological knowledge and reaearoh to the 
creative techniques in making effective advertising bccau.se the function 
of advertising is payohologic as well ns economic. This iwcUuIcS evalua- 
tion and measurement of copy appeals, lay-out, art, and media. It tries 
to answer the question, "What is the most effective way to prcacut the 
values in a given product so that the message will penetrate the minds 
of the consumer, become a part of his memory equipment, and result in 
persistent purchasing habits?” 

2, The use of consumer survey methods to investigate product ac- 
ceptance or rejection, penetration of advertising appeals, public nttitudes 
toward business as a whole or some specific industry, opportunities for 
new markets, consumer buying power and preferences, rcadorslup of 
magazines and newspapers, and radio listening habits. 

3, Library research— analysis of sales and distribution data, analysis 
of coverage and audiences of various media, study of the laws and regu- 
lations governing advertising, verification of claims made or to be made 
in ads, seeking and documenting incidents, events, personalities, and 
ideas to be used in advertisements, A multitude of other services, too 
numerous to mention, fall into this category of work, 

Now to illustrate with specific examples the ways in which these 
types of research work out in fact. Projects ” A’* through exemplify 

the firflt type of investigation. 

Proiect A, You are aware of the existence of a group ol 
called the '^Women'^ Service Books” written expressly to women. These 
magazines are advertised to advertisers just like any other product. 
Obviously the advantages in reaching a femimne audience with a product 
story in this type of publication, as against the general audience media, 
resides in the known fact that the interests, attitudes, and needs of 
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women are different from those of men. In order to specify and drama- 
tize these dilTcrencea, an investigation was begun to canvass known differ- 
ences in interests, abilities, attitudes, and acliievement between the sexes. 
This study necessitated a search of the biological, sociological, anthro- 
pological, and psychological literature to establisli a factual basis on 
which an advertising campaign could be built 

Projed An investigation of the sexual attitudes, myths, preju- 
dices, and taboos of women members of various religious faiths and sub- 
cultures wliicli motivate against the use of tampons for menstrual pro- 
tection — accompanied by a study of the types of advertising appeals most 
likely to combat tliese resistanceg. 

Projed (7. Tho pre and post appearance evaluation of copy appeals 
through the use of consumer jury tests, consumer panels, split-runs, test 
city campaigns, coupon returns, and readership studies. 

Projed D. The use of Olco-margarine has become a war-time nece*s- 
sity. In order to increase the use of this product, it wa.s necessary to 
discover the housewife’s atlitudo.s, botli favorable and unfavorable, 
toward its use and translate the information into an educational cam- 
paign to change her food use habits. Because of food scarcities and 
rationing this procc.ss has been carried on for many products, cereals for 
example. 

Three kinds of investigation wliich characterize the second typo of 
research follow: 

Project E. One of the irksome problems of logistics wag tho protec- 
tion of ordnance and machinery from corrosive moisture during storage 
and sliipmont. The method in general use was to immciflc the materials 
in oil or grease. Tliis was both time consuming and expensive. Scien- 
tists, put to work to develop a more practical device, discovered a com- 
pact crystalline chemical ab9orl)ont which could be packed along with 
the material in a sealed plio-filrn envelope. It was a simple, bub com- 
plete solution. 

The manufacturer of this product soon realized its value for de- 
humidifying jnirpo.scs in homc.s and industry. It will be among the 
many new products available to make our living more comfortable in the 
post-war era. Our prQt)lom is to discover its potential u.ses in home and 
indiisbry. At this moment Imndreds of liomea in the high humidity belt 
are experimentmg with samples of the material and will tell us what it 
will do, how it can be u.sod, how they like it, where it should be sold and 
lor how much. 

Project h\ The ro.soarch (mgineev of one of our clients wuis asked to 
develop a more accurate and sturdier device for the measurement of 
extreme temperatures in aircraft crigines. Although the method cannot 



be revealed, lie employed a simple electrical principlo in making a new 
thermometer bulb which gives precision and hardiness characteristics far 
beyond the rigorous specifications set for it. Tho device may revolu- 
tionize remote temperature control. Our job is to investigate its possible 
uses in post-war industry, especially in the chemicals, plastics, and food 
processing industries, and to estimate its potential market. 

Project <?. Package design is an important element in tlie readiness 
with which women will buy a product. Given three different designs 
for a disposable tissue container Bubmilted by a famoua designer, which 
one will women bo most likely to buy and why? Using a paired-com- 
parison method, we asked a representative sample of women and got the 
answer. 

As a sample of the third class of research hero are two typical ap- 
proaches. 

Project War has brought many critical problems to the stocking 
industry, Problems of new eynthetic yame, new methods of manufac- 
ture, new styles, price control, and limitation on production. Mills have 
gone out of business and branded lines have lost position. These factors 
will have profound effects upon the structure of the business following 
the war. In order to prepare for any eventuality a client commissioned 
us to make a complete analysis of the industry covering factors effecting 
maolunery, production, labor costs, sales, styles, and methods of distri- 
bution, pricing, merchandisitig, and advertising. This could all be done 
at a desk and is what we call library research. The resulting data, 
coupled with informed guessea baaed on experience, led to the formula' 
tion- of several alternate plans or policies of operation which might be 
put into effect in the post-war era, depending upon tlie prevailing 
conditions. 

Project 7. No one had ever made a study of the economic impor- 
tance and social aignifiennee of home-sewing to tlie life of the nation. 
The shortage of paper necessitated accurate information on which the 
government could base allocations of paper for the pattern industry, 
for patterns are the blue-prints, the basic tools, used in home-sewing. 
Exhaustive research into this problem revealed some interesting impli- 
cations for the utilization of productive woman power, control of infla- 
tionary tendencies in the ready-to-wear industry, and the restraint of the 
cost of living for the great mass of wage earning families. Wo learned 
that mors than 100 million garments were made at home during 1943, 
fifty-four per cent' more than in 1939. That more than oigbty-two per 
cent of all homes own sewing machines and that more than 500 million 
work hours were utilized in creative, useful labor, at an unbelievably 
small cost in paper tonnage. These facts arc only a small part of the 
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findings. The completed report makes a tenable case for home-sewing 
as an important influence in the control of a war economy. 

You have had a rough picture of the scope and importance of tiie 
paycliologiats' work in business and industry. True, some of it is far 
afield from applied psychology, but none of it is remote from the appli- 
cation of scientific methodology or tlie study of aspects of human eep^ 
nomic behavior. The logical next question to be answered here concerns 
the training which will beat fit candidates for positions in this field. 

Training for Business Research 

In my opinion the ideal preparation will include scientific psychology, 
business and economic training, and pmctical experience to develop 
apecial skills, in that order of importance. The formal curriculum should 
include experimental and social psychology, scientific method, studies in 
motivation and behavior, and statistical melhoda. Otlier studies to 
round out the program sliould include sociology, economics, business 
administration, merchandising and marketing, advertising, and the tech- 
niques of marketing and public opinion research. 

Finally a program of internship study of at least one year with an 
independent rcscavch organization such as the Psychological Corporation 
or the research department of a large advertising agency. With this 
background the beginner will be ready for one of the many iunioi posi- 
tions on the road to a position of major responsibility. 

Post-War Opportunities 

Today there is a real occupational challenge for psychologists in 
business and industiy. They have a genuine stake in the increased role 
research is to play in industry’s program of production for use, and the 
vast problem of reconversion of industry. It seems clear that the major 
post-war problem facing this country will be the prevention of unemploy- 
ment. The solution can lie only in increased production of consumer 
goods, for production means employment. Similarly, production re- 
quires purchasing power and markets which employment guarantees. 
The development of new markets, the lifting of the American, standard 
of living so necessary for expanding employment opportunities will pre- 
sent inicrea.siTigly difficult, widely ramified and interesting problems for 
research. 

Business and industry is acutely aware of this condition and is ex- 
panding Us re.search and planning facilities to cope with it. There ia a 
rising tide of confidence in the specific contributions psychology can make 
to the solution of the many dilemmas facing them. During the past 
few years, independent research organizations have sprung up all over 
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the country^ some large industries have organized extensive departments 
of their own, while advertising agencies have cxjifinded and strengthened 
their research programs to meet the needs of their clients. In the opinion 
of the leaders, this expansion will continue well into the period of eco- 
nomic readjustment. 

Continued development will provide the opportunitj^, if the i)sy(!holo-' 
gists, who are best prepared to direct this work, arc willing to dernonstrato 
their interest and ability and to apply their science toward the solution 
of problems affecting the daily life of all of us. 

Rmmd March S9, 1944- 



The Psychological Corporation Index of Public Opinion * 

Henry C. Link 

The P8\^tdlOQ\cal CoT’poTalion, Nm York City 

This is the eleventh in Series B of the nation-wide studies of public 
opinion conducted by The Psychological Corporation. Series A, gener- 
ally known as the Psychological Barometer, was begun in September 
1932, and is now the oldest periodic poll of public opinion and buying 
habits in existence. A total of 65 nation-wide surveys with 412,000 
personal interviews has been made in this aeries which ia currently being 
conducted quarterly with 10,000 home interviews each. 

Series B was begun in September 1937 and several of the eleven 
surveys have been reported in this Journal. The present survey is based 
on 5,000 personal interviews made by 437 intevviewers under the direc- 
tion of 115 psychologists associated rvitli The Psychological Corporation. 
The interviews were mode between October 6 and 30, 1944, in 113 cities 
and towns representing a national croas-scclion of the urban population. 

The exact questions used are given below, though not necessarily in 
their exact order. Most of the questions were asked of only half the 
sample, or in 2,500 interviews. 


Wages and the Co.st of Living 

Q. "Is your family more prosperous (or better off) today than two years ago, 
less prosperous, or the fiame?" 


Apsworg 

In Oct. 
1041 

111 Nov. 
1042 

In Oct. 
1043 

In Apr. 
1944 

In Oct. 
1044 

More proapGroua 

38% 

29% 

20% 

28% 

31% 

About the same 

47 

47 

40 

48 

46 

Leea prosperous 

16 

21 

23 

22 

20 

Doa^t know 

— 

3 

2 

2 

3 

Total interviowa 

2,000 

2,500 

2,500 

2,500 

2,500 


In spite of the increases in the cost of living and heavier taxes, 77 per 
cent said they were us pro,sl>croU8 or more prosperous than they were two 

* To coiisorvo spaco and also paper further details of sampling and procoduro arc 
omitted in this report. For full details aeo If. C, Link, Tenth nation-wklo experi- 
mental survey, J. appl. Paj/chol, ID-U, 28, 363-375. Also, to conserve apace and paper 
only the barest explanatory comments are included with the present results. The full 
report moy be obtained by writing to Tlio P.sychological Corporation, 522 Fifth Avenue, 
New York IB, New York. 
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years ago. This increased or equal prosperity, as will be seen from the 
following table, is highest among the C nnd D, or tlic large factory and 
wage-earning groups. In these groups, constituting about CO per cent of 
the urban population, over 80 per cent admit to unimpaired pro.sperity. 
But even in the predominantly white-collar and executive groups, A and 
B, over 73 per cent admit to continued prosperity. 


October 1G44 

Total 

A 

By flocio-Ecoii. Groups 

B CJ 

D 

More proaperoufl 

3i% 

28% 

27% 

34% 

34% 

About the same 

46 

40 

40 

46 

47 

Less prosperous 

20 

24 

24 

18 

15 

Don^t know 

3 

2 

3 

2 

4 

Total interviBWB 

2,600 

250 

760 

1,000 

600 


Labor Riots va. Race Riots 

Q. "Which do you think will happen most olten in tho next two years, race riots 
or labor riots?" 


Dy Socio-Eoon, Oroiips 


Anawera 

Total 

A 

B 

G 

D 

Labor riot-a 

45% 

44% 

44% 

47% 

41% 

Bace riots 

31 

31 

38 

30 

24 

Neither 

7 

0 

5 

8 

D 

Both 

3 

6 

2 

2 

3 

Don't know 

14 

10 

11 

13 

23 


The Roots of Free Enterprise and Post-War Planning 

The individual American and his family constitute the roots of free 
enteipiise, capitalism, and post-war planning. Post-war planning, to 
date, has been primarily a matter of government agencies on the one 
hand ond business organizations and groups on the other. Therefore, 
it was decided to devote the larger part of the present BUrvey to a study 
of the post-war plana being considered by individuals. However, ins toad 
of limiting the scope of this planning to articles they wore going to buy, 
our inquiry included tlie hinds of jobs they were planning to hold or to 
obtain, plans for education and travel, and plana for going into business 
for themselves. 

Q. "As you know, making jobs for tho rotutning soldiors end many otlicra ifj going 
to be a big problem, Have you hoard or icod about any business organizations who 
are pliuming for poat-^ar joba?^* 
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64% anaworcil 
40% answered ‘^No.** 

Q. "IlavQ yon heard or read of any planning for poat-war jobs by tho Government 
or Government bureaus?** 

62% answered “Yes.*' 

38% answered “No.** 

Q. *^Do you think that planning by the Government find busmess concerns will 
be enoiigli, or do you think that the head of every family and every returning soldier 
should also make a post-wav plan o( hia own?** 

11% thought this would bo enough. 

80% thought individual plans also necessary. 

0% were uncertain. 

Q. “Have you or the head of your family made any poatrwar plana? That ia, 
have you made any plana on how you are going to uao your war^limo aavinga and bonda 
when the war ia over?** 





Dy Socio-Econ. Groups 


Anawers 

Total 

A 

B 

C 

D 

Yes 

54% 

60% 

58% 

89% 

44% 

No 

46 

60 

42 

41 

66 


Q. “(If Ycfl in previous question) Would you mind tolling me the things you 
and your family are going to do or buy in the order in which you arc now planning to 
do them?** 

Answors Total 


Homo, farm, bungalow 22% 

Household appliances 18 

Automobile 17 

Furniture and fiirnistiings 0 

Trip or vacation 7 

Education 7 

Household repairs 6 

Go into buBinesa 4 

Clothes 2 

MiacolbneoUB 13 


The emphasis in most studies in this field has been on buying rather 
than on doing and, as a result, distorted results have usually been ob- 
tained. The diatortion is an overemphasis on the purchase of movable 
articles as compared with such items as education, traveling, going into 
business, building, redecorating. For most plans some capital and spend- 
ing ia necessary. However, our testa proved that the emphasis on spend- 
ing tends to make people answer in the other extreme, which ia saving, 
holding on to their bonds. For these reasons surveys previously made 
have produced conflicting reports. Some have shown primarily the 
enormous ptirchosea which people were going to make. Others have 
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indicated the large extent to whicli people were Roijig to liold on to tlieir 
savings. 

Q. "Aubomobilcs, wnaliera, radios, hoiiHCs, may l)C aimul 20 prr coni lii^hnr in 
price TvWcn they come back. In that cage would y<ni hUU buy them?'* 

00% answered *'YdS." 

32% anfiwored "No/* 

8% were uiiccrlain. 

q. "(If answer was No in Q» 4) Why would you f*ay yciu luivo mado iin pltiusV'' 


Answers Total 

Uncertain as to end of war 10% 

Ilnven' b cnougli bonds or navings 0 

Haven't thought about it r> 

Will hold bonds until maturity d 

Don’t oxpeeb to need anything 4 

No particuiar reason 3 

Do not use Bavingfl to buy things 2 

Total 40% 


Q. "How much of the money you have saved since tlio war do you oxpnot to ubo 
within a year or two after the war atopa— nU of it, two-thirds of it, onc-lhird of it, or 
none of it?" 

Of all respondents, 21 per cent said they woro imcortaiii, while 7 per cent eaid tlioy 
had no savings. The renmiuder were pkmiiug oa follows: 

48% planned not to spend tmy savings, 

24% planned to spend one-third* 

15% planned to spend two- thirds, 

13% planned to spend all thoir savings. 

Q. "Are you or the head of your family pretty sure of hoing nl)le to keep your 
present job after the war?" 

52% answered "Yes." 

16% answered "No," 

16% had their own business or profession- 
7% were uncertain. 

Q. "(If anBWBT waa Yea) Do you believo that your pay check will bo as high, 
higher, or lower than now?" 

28% answered ns high, 

15% answered lower. 

6% answered higlior. 

13% were uncertain- 

Q. "(H auBwor was No) If you think it likely that you will Imvo to olmitgo from 
your present job into a peace-titne job, aro you fairly Buro of getting such a job?" 

8% answered "Yea." 

6% answered "No." 

1% wore uncertain. 

Q. What are your difRcultics in making a definito poat-war plan for yourself or 
your family?" 
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Nn in ,' 37 % 

nf cninliiionJi llm wnr ,'^0 

1 iloii'i knr>w wIjilL my jnli or inroinn will Im 7 

1 wail fi;r my InmlKilul or ^nn lo come luiiiio (1 

llaVO no ‘ nviiiK"' -1 

l^r.catiHo of ilium 3 

Too uM (o plan; will retire tioon 3 

iJoo'l know; no answer ^ 


Q. n. yon Innl yo?»r rlo/icf? (f*r; If yon vvoro Un a linslwunl or n l^rotljor) 

wjjftL work or occu|nilion wotilil you elu)fn?o, nfUit llus war, of uourwoY" 

Q. )j. "What lire you fhiin^ univY" 


AiiHW(5rft 

Doing Now 

Would Cliomo 

Joh with 1). S, Govcmniciit 

7% 

21% 

Job with City or iSfalo (lovornmeni 

0 

0 

Job with largo privtvU) coinj>any 

25 

25 

Job wlili Hiimll privuto compiniy 

17 

23 

Own buHinCvSfl 

10 

11 

Proicbfwr, doalor, lawyer, Icftclior 

7 

b 

In Army or Navy 

11 

* 

farmer 


l 

Miacollancons, doji^t kntnv, no jimn 
+ LcBfl Ibnu Ji per cent 

10 

0 


Remved Jenmry j8> 10^5. 



A Method for Investigating Color Preferences in Fashions 

B. R. Philip 
Fordham Unimiily 

Moat investigations of fashion preferences havo been based upon 
queationnairea. With the exception of Jacobson’s (1) work little dimen- 
sional analysis under objective conditiona has been attempted in this 
field. To determine whether the paucity of experimental work may he 
asoribftble, in part ah least, to the difficulty of adapting modern tech- 
niques to this field, the welbknown psychophysical method of ranking 
waa applied to the study of fashion preferences. Since the dimension 
selected was that of color, it was proposed incidentally, and by way of 
exemplifying the method, to determine whether men and women differ 
in their fashion preferences along that dimension. As this was an ex- 
ploratory study only, few subjects were used, and the atatiatical tcoh- 
niques were carried out by the methods of small sampling, 

One of the chief difficulties in an experimental study of fashion is the 
eeleotion and presentation of the material. Obviously each subject must 
have ample opportunity to observe tlie material under the same standard 
conditions as every other subject. Were all observations made upon 
actual costumes, it is probable that ether lactora would tend to obscure 
the teal facta, and validity would be secured at the expenao of other 
qualities. Some procedure must bo found to condense tho material, to 
shorten the observation time and to equate observational conditiona for 
all subjects. 

Fortunately, instead of actual costumes, colored reproductions may 
be substituted with some confidence in the validity of tho findings, 
People are accustomed to study fashions in this way, and often have 
recourse to pictures of garments to make their actual selections when 
purchasing clothes. One could proceed with much greater confidence if 
published experimental studies gave actual validity findings. To our 
knowledge, none have appeared in the literature. An unpublished study 
of the author, based on data from 19 men and 24 women in one group, 
and later, from B6 men and 106 women in another group, yielded average 
coTielations of 0.85 for the men and 0.95 for the women, between prefer- 
ences for actual material (Scotch plaid scarves), and' colored pictures 
projected on a screen of these same scarves, when both rank order and 
paired comparison methods were employed. Accordingly it was decided 
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to uBe colored faHhion platca in lieu of actual costumes. In order to 
make sure that those costumes wero in fashion, they were all selected 
from yofluc; for the current year, 1941, when this work was done.^ 

The material finally selected consisted of live sets of colored fashion 
plates. Each set consisted of 25 cards, all of the same siz^e and showing 
one costume, commonly known as an afternoon dress; the costumes 
differed from card to card in some details, such as cut, ornamentation, 
etc. Within a set tlio costumes were of five different predominating 
colors, Black or Gray, Green, Blue, Ued and Brown. There were five 
cards of each color, which differGd considerably in hue, saturation and 
intensity; they were mostly monotone, although a few were striped or 
mottled. The sets diflercd among themselves in the height of the figure, 
which varied as follows: Set A, 11 inches; sets B and G, 9 inches; and 
sets D and E, 7 inches, The figures were cut out in silhouette and 
mounted individually on white cardboard, so as to leave an ample mar- 
gin. Thus tlxe size of the card iu set A was 14J^ X 8 inches, and in sets 
D and E, X 5 indies, A small code letter at the top of each card 
was inserted to permit of ready identification. 

In the coding the scciiience of colors was always the same, Black or 
Gray, Green, Blue, Bed and Brown. Thus the letters, a, /, A, p, and u 
always designated a Blacdc or Gray card, and b, Z, g, and f, a Green 
card. This coding flyatem was intended to permit easy segregation of 
the colors in taliulation. However in the actual experiment the cards 
were always presented in random order to the Ss, no one of whom no- 
ticed or understood the system used in coding, 

The procedure was simple. College atudeiita, 19 men and 9 women, 
were given a set of cards randomly arranged to lay out, in order of prefer- 
ence, on a long table. They were provided with a set of typed instrue- 
tions as follow,^: 

Rank the following set of cards according to preference, placing the card you 
moat prefer in 'number one position, and placing the cara you least prefer in 
the last (25th) position. Ratinge are to be based upon general preference; 
all factors being taken into account. The question to be answered is simply, 
Which outfit do you prefer?'' No tics are allowed, but the cards may be 
sliifted in position ris often as preferred. Work quickly, and do not delay too 
long over any choice, 

Tho sets wore presented to the subjects in random order to equalize 
practice cfTocts on the judgmcnlH of the various sots. All the rankings 
wore entered on specially prepared tabulation sheets. One set only was 
ranked by every subject at the experimental sessions, which occurred 
bi-weekly. The purpose of sijacing the experimental sessions was to 

* Acknowledgment ia hero made to tho Condo Nnst PviblioatiouB for a^ipplying this 
material 
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minimize the "halo effect" and fatigue or boredom. To determine test- 
retest reliabilities, some six weeks after tho ranking of the (ifth set, the 
experiment was repeated for the women; tho men were not available for 
this phase of the experimentation. By this procedure it was hoped that 
indications might be found whether or not there would bo any time trend 
in the fashion preferences, while the costumes were still in fashion. 

Ile.suits 

The data were treated separately for men and for women. Linear 
scale values were computed by Guilford's method (2) nssiiniing a com- 
posite standard baaed on the group of stimuli within the set, as a whole. 
Scale values were used rather than mean rankings in order to evaluate 
the dispersions of the judgments of one set as compared with another, 
The scale values in each set were then totalled for each group of colors, 
to form a five by five table of colors vs. sets, which was subjected to 
analysis of variance. As a check on the procedure, an analysis of vari- 
ance using total ratings rather than scale values yielded substantially tho 
some findings. 

A point of some importance in this type of material is to determine 
how consistently the rankings are made by the individual and by tiie 
group. The degree to which the members of a group agree in their 
rankings may be inferred from the average intercorrolationa of tho rank- 
inga on any one set of cards. These intercorrelation values as dotorminecl 
by Kelly’s formula, number 172, (3), and listed in Table 1, arc positive 
and low, and average 0,220 for the women, and 0.134 for the men. 


Table 1 

InteTDorrofations of Bntings from Difforenk Sets of Cartls 


Set 

Mea 

Women 

5‘irst Ratiag 

Women 

Second Rating 

A 

0.1G9 

0.203 

0.163 

B 

0Jd5 

0.267 

0,176 

C 

0.135 

0.327 

0,327 

D 

0.095 

0.171 

0.204 

E 

0.136 

0.13T 

0,243 

Mean 

o.m 

0.221 

0.220 


The reliability of the individual rankings for the women, from n retest 
after six weeks, based on the correlations of the first and the second 
rankings of a set by the same individual, is relatively high, since an 
average reliability of 0.593 is found from all five sets (Table 2). Since 
the complete experiment is based on the rankings of five sets, were we 
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Bet 

Per Subject 

Per Card 

A 

0.M4 

0.801 

B 

0.008 

0,836 

CJ 

0.5rj3 

0.885 


o.m 

0,700 

IC 


0.813 

Momi 

0.503 

0.825 


to estimate the test reliability by applying the Spearman-Brown for- 
mula, tlie correlation becomes 0.879. 

This is an average tcst-rctest reliability subject f but the average 

test-retcat reliability may also be determined per card. It is obtained 
by correlating, by the rank-dilTercnco mctliod| the total rating scores per 
card, yielded by the first nnd Hccoud ratings. This procedure is, in eflect, 
a moasuro of the reliability of tlio group. These reliabilities are also 
presented in Table 2, from which it is seen that the average test-retest 
reliability per card is 0.825, which, when stepped up by the Spearman- 
Brown formula, becomes 0.959. 

Accordingly the test employed is of satisfactory reliability, yielding 
fairly consistent results for the same individual, although individuala 
differ eonsklcrably among themselves in their preferences for any par- 
ticular costume. Furthermore, after a lapse of six weeks, the group 
judgments arc more consistent than the judgments of an individual. 
It is chiefly the reliability values found that give some confidence in the 
technique os liere outlined for the investigation of fashions. 

Since the experimental set-up was designed to investigate fashion 
preferences along a dimension of color by analysis of variance, it seemed 
of interest to do so, although it was recognized that the very small 
number of subjects would make any conclusions only very tentative and 
exploratory. The results are presented with this caution in mind, and 
are of course, only applicable to this group of subjects. 

Analysis of variance discloses that the color of the costume is a 
statistically significant factor in the fasliion preference for the men, but 
not for tlic women, in this experiment. For significance at the 1% and 
5% level and with appropriate degrees of freedom, F = 4.77 and 3.01 
respectively; the F values obtained were 18.63 and 2.26 for men and 
women respectively. 

In order of preference the colors for the men were Blue, Black, Green, 
Red and Brown. The preferences for Blue were flignificantly greater at 
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the 1% level than those fov Green, Red and Brown; for Black, signifi- 
cently greater at the 1% level than those for Red and Brown; and for 
Green, significantly greater than for Brown at the 5% level. As was 
stated, color preferences for the women are not statistically significant, 
but the order of preference was Green, Blue, Red, Brown and Black. 
Mean linear scale values, assuming a compo.sitc standard, aro given in 
Table 3. This table implies that Blue costumes were on the average 


Tabic 3 

Mean Linear Scale Values for Colon? 



Black 

Greon 

Blue 

Red 

Brown 

Mei\ 

’Women 

0.132 

-0.124 

-0.011 

0.145 

0.259 

0.122 

-O.lOl 
- 0.060 

-0,101 

-0.117 


assigned by the men a scale position 0.259 standard deviation times 
higher than the mean rankings of ali the cards in a set. Here tlic positive 
sign indicates a more favorable preference than tlie average. 

One might also determine the tendency to make preferred judgments 
for the colors by noting the percentage of times the various colors 'were 
given scale values greater than the mean scale value in each sot. These 
percentages are given in. Table 4, which confirms, in general, the findings 
based upon mean scale values. 


Table 4 


Percentages of frequency of Preferred Selections for the Various Colors 



Black 

Green 

BUvo 

tied 

Brosvn 

Men 

6B 

44 

76 

32 

32 

Women 

48 

68 

66 

48 

36 


The men are more prone to group around the mean judgments of 
costumes that have no marked positive or negative appeal; the women 
show greater dispersion of all judgments. Thus the relative proportions 
of judgments with scale values plus or minus 0.2 standard deviations 
from the mean, are 54% for the men, and 35% for tlic women; and for 
scale values plus or minus 0.4 standard deviations from the mean, 81% 
for the men and for the women. 

Since such a high proportion of cards were grouped about the mean, 
the implication is that no clear-cut preferences exist for many of the 
costumes, and definite preferences or rejections exist only fov cards 
ranked in. extreme positions, A listing of such preference, s is given in 
Table 6, where the order of the color of the fi.ve most preferred costumes 
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Table 5 

Difltrii)iition of First Five and LilsL Five Choices per Set According to Color 



Dlftck 

Green 

First Choicca 
Blue Rod 

Drown 

Total 

Men 

8 

2 

11 

3 

1 

25 

Women, I 

3 

4 

11 

6 

2 

26 

Women, II 

i 

4 

11 

4 

2 

26 




Lftflb Choicca 




Black 

Green 

Blue 

Bed 

Drown 

Total 

Men 

2 

— 

1 

10 

12 

25 

Women, I 

7 

3 

3 

6 

e 

25 

Women, II 

7 

2 

a 

7 

fl 

25 


The distribution of the choices for the firat and for the second ratings are listed 
along the rows Wornou I and Women II. 


per set corresponds quite well, for the men, but not for the 'women, with 
the linear scalo values. 

In the preferential positions the men in our experiment select Blue 
first and Black next, and in a decided manner they show least preferences 
for Brown and Red. The women also select Blue moat frequently in the 
preferential positions, witli fcho other colors occurring in about equal 
frequency. They are prone to spread their least preferred judgments 
among all the colors, "With an indication of lesser allotment in those 
positions to Green and Blue. Green is the favorite choice for the women 
when all the cards are considered, as may be seen from the listing of the 
mean scale values, and from the percentages of preferred selections, 
although it does not receive as many preferred choices as does Blue. 
A point of interest is the close agreement of the first and second ratings 
of the women, confirming the reliability values found. 

In summary we may state that this technique of investigating fash- 
ions is of adequate reliability. With the caution that this investigation 
has been carried out with few subjects, and that factors other than color 
such as stylo and pattern were not controlled, there are iudicationg that 
the men place considerable emphasis on color in their rankings, Blue 
being the favorite color and Black the next. The women base their 
selections on a veiy composite criterion, as was pointed out by Ilurlock 
(4) and by Barr (6), but Blue is for them also a favorite color, ranking 
slightly after Green. However their color preferences are subordinate to 
other factors in costume selection, and in this investigation were not 
statistically reliable. It is of interest to note that the colors selected for 
this investigation are the live moat preferred colors as found by Barr (5) 
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from her queationaaire, and the order of preference Is closely the same in 
both inveatigationa. 
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Test Profiles as a Diagnostic Aid: The Minnesota 
Multiphasic Inventory 

Lt Col Hermann 0. Schmidt, AGD 

Liiifobi Artivj ylir hinroln, Nebraska 

The |)iiri)<)S(! of IhiH pii[)(*r ih to j)ro.scnt some findingfl in the use of the 
MinnoKotii Mnlliplinsie PcrHomilily Inventory in u clinical .situation. 

No altciii|)L will 1)(> iimde Ikm’o to dcscriljo the devclopjncnt of the 
lest, nor its :ii)i)li(!ul)ility us a clinical instrument fliiice those have been 
described elsewhere by its nuUiors (1, 2, 3, <1, f), G, 7), by licveronz (8), 
and by Schiele, Uiiker iind Ilatliawuy (9). 

The test eonsisls of GGO items printed upon cards. The subject is 
nsked to lile these cards into any one of three categories: Trite, False, 
Cannot Say. The le.st conluin.s 12 scales: 3 validating scales. Question 
(cannot siiy), Lie and False; and 9 diagnostic categories: Hypoohondriasia 
(II,), Depression (D), Hysteria (Ily), Psychopathic Deviate (Pj), Mascu- 
linity-Foininioily (M,), Paranoia (P,), Psychasthenia (P,), Schizophrenia 
(S,) and Hyponiania (M,,). 

The data have Innui gnthened ov(;r a period of 9 months from cases 
studied in tins Con.suUation Herviee of an Air Force replacement pool. 

Procedure 

The Multij)l>asic Inventory was administered as prescribed in the 
manual of diroeliona (C), It was given in so far as practicable as part of 
tlie routine on the o])eiiing of a case. However, the pressure of time and 
the lack of .minicient teat sets precluded the possibility of testing all cases 
coming to the Service. 

All diagnosc.s were made by qualified ncurop.sychiatrists, employing 
classifications in common use in the Army, which in the main follow 
civilian ijractice. 

This was not a controlled cxj)criinent, in the sense that careful selec- 
tion of normal eases was sought, or tliat purc-culture clinical groups were 
(or could l)e) cinidoyed. Yet, there is reasonable certainty that the lest 
did not inducncc the clinical cliagnosi.s. Tliree of the four neuro- 
p.sycliiatrisL4 making diagnoses avoided the tc.st, merely finding it inter- 
esting a postiori that it .seemed to agree with the clinical findings. The 
fourth neur()p.sycliiatri.st was quite interested in the test, but with a view 
to assisting in this validity study, he was careful not to sec or to discuss 
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the teat on a particular individual until after lie liiid nmde liia clinical 
judgment.* 

The Subjects 

The subjects were all ivhite male enlisted incmbcis of the Army Air 
Forces. The clinical groups had been referred to the Con-sultation Serv- 
ice because of difficulty in adjnaUng to tUc Army aituatian. The novmivl 
group was being re-evaliialed, either because its rccord.s had become lost, 
■were incomplete, or because there existed ovomgea in. particular occupa- 
tional specialties, making reolaasification necessary. 

The deviate groups consiated of 121 subjects who fell into the diag- 
nostic categories: constitutional psychopathic state, juadciiuate person- 
ality; constitutional psychopathic state, sexual psychopathy ; psycho- 
neurosis, mild; peychoneurosis, severe; and psychosie. There were sev- 
eral other groups, such as Organics, Simple Adult Maladjustment, Alco- 
holics, etc., but the cases were too few to have Bbatigtica! significance and 
are not included here for that reason. Clinically, they were differentiable 
by profile. Table 1 gives descriptive data on the various groups a.s to 
number, age, intelligence, years of schooling, montjis of service, marital 
status, rank, number of states represented, population of tlie home town, 
and final disposition of the men who Imd been studied. This latter 
column consists of a percentage computation into 5 categories; di-scharge 
from the military service; limited military duty; fuU field duty; hospi- 
talization (in most cases general hospital is implied) and duty (?). The 
lost named category comprised those men on whom the follow-up data 
were incomplete, the only thing being known was that they wore returned 
to duty, but whether on a full or limited duty Btatus could not be 
ascertained. 

The normal group Na^ consisted of 98 subjects, who upon inquiry 
manifested no evidence of overt or covert personality disorder. Their 
civilian and Army histories were devoid of any indication of disturbance: 
some had been overseas, but in a quiet theater; some had "washed-out” 
as aviotion cadets, primarily for lack of psychomotor adaptability; but 
no trauma could be detected subjectively as attending cither of these 
major sources of normal cases. 

In all groups, by inspection, the descriptive data (Tabic l) appeared 
te have a noimal diatribution generally and to bo comparable. How- 

* I ehowld like lo ucknovdedgo here my indobtodness to lafc I,t. Il(jliiud A. hoslie, 
MC, for ofisistaiice and inspiration os a follow-workor and in tho propiirntioit of this 
paper. 

•Hereafter the syrobola N„ C„ C„, p, and P., vfill be used to dwigimti} the 
noi^l group; OPI, inadaquate; CPI, wximl psynhaputby; mild neurotica, flovero nou- 
Totica and paychotio groups, respectively. 
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ever, the intellectual distribution is skewed aomowhnt Lo the left, in that 
no Army General Classification Test group V’s were given the teat. Tins 
was because oJ the highly questionable ability of this low grovip to com- 
prehend the various test items, 

Results 

Figures 1-5 show graphically the T-acorc profilc.s of llui (-'p, (In, P„,, 
P, and P.B clinical groups together with the No group, 

Multlphasic Scales 
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Fig. 1. T-score profiles on the MuUiplinaic Inventory for Die Normril {No) mid 
constitutioiml psychopathic state, iTindcqnate person iility (C,,) groujis. 
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Fig. 2. T-score profiles on the Multiphosia Inventory for the Norma! (iV^,) and 
constitutional psychopathic abate, sexual psychopathy (Cu) groups. 
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Fig. 3, T-acore profilca on the MuUiphfiaic Inventory for the Normal (A^o) nnd 
psychonGuroa'iB, mild (P^) groups. 
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Fia. 4» T-aeorc profiles on tho Multiphasic Inventory for the Normal (Na) and 
psychoncurosis, severe (Pt) groups. 

Table 2 presents the means, sigmas and vangca of all groups; and 
Tables 3, 4, (5, G and 7 give the differences, standard errors of difference 
and critical I’atios between the various groups (T-scorc values, iincor- 
rected for small samples or beyond 1 decimal point). 

It is at once apparent from inspection of Figures 1-5 that the deviate 
groups present different and characteristic profiles from those made by 
the normal group. 
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The profile for the Nc group iu rcnsonably flnt niul npproaclies closely 
the T-score meau level of 50. It is somewhat lower Renorally than this 
mean range of 50 and lower than the normal curve foimtl by Leverens (8). 
Within its own configuration the low point is reached on the dcpre.sHion 
scale; while the high point is for paranoia. 

The profiles for the deviate groups show obvious divergence from the 
normal profile. In all instances the curves are higher, being le.s8 bo for 
the group and maximum for P,y, The dciire.ssion scale tippcarH ns an 
index to the seriousne-ss of the difficulty. It is liighcv than either liypo- 
chondriasis or hysteria in the P. and P.v groups, and lower for all the 
others. In the case of the C,i group, the profile rise.s on the masculinity- 


JJhiltipbaaic Scales 



Fw. 5. T^scotq pTo&lea on the Multiphasio Iikvontory for the Nornin^ {No) 
psyohaais {P%v) gi'ouijg. 


femitiiiiity scale whereas in all tiie other groups the curve is depressed 
at this point. By way of indicating charncteri/jng features of tlie various 
profiles, it may be noted that: 

( q ) The Nd profile, although generally a atraight line at T-score mean level, 
shows a low-poiiifc at depression and a high-point at paranoia; 

(5) The Cp curve hag high points about 2 sigmas above mean level through 
the pgychopatluG deviate scale, drops to nearly normal at masciilinity-fcini- 
nmity^ rises to paranoia, drops again slightly on psychaHtlionia, rhsos to schizO' 
phretiia and falls off on hypomaiha; 

(d) The Cji profile ia approximately a atraight line, betwoou 1 and 2 sigiuas 
above the mean level, with high-pointa on the maficiilinity-feinininity mill 
schizophrenia scalea; 

profile, at about 1 sigma above norma), descriptively hIiows a 
high level at hypochondriasis-depreasiou-hyatGria (claptesftiou lowest), dvopplug 
sharply on masculinity-femininity and rising sharply again to nsyohasfciiciiia- 
schizophrenia; 
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Table 6 


Comparison of psychoncuroaia, niilcl (Pm), and the clinical groups of psychoneurosia, 
severe (P0» «-nd paycUoaia qu the saparate Multiphaaic luvontory acalca 
allowing difTcrence, standard error of diilercncG and critical ratio of T-scorea* 


Pn, 

n, 2(i 

P. 

n, 04 

P., 

n, 13 


Pm-P, 





Dif. 


n/sBdif. 

Dif. 

Sliidif. 

DfSEair 

? 

-'.8 

1.3 

.6 

-1.1 

1.4 

.8 

L 

,2 

.0 

.2 

.8 

2.1 

.4 

F 

4.0 

2.0 

2.0 

G.l 

3.4 

1.8 

II. 

l\A 

3,7 

3.1 

4.7 

5.5 

.9 

D 

20.1 

4.0 

4.1 

21.5 

8.7 

2.5 

Hy 

12.7 

4.3 

3.0 

4.0 

6.8 

.6 

P.I 

13.1 

3.0 

3.0 

10,2 

7.1 

2.3 

Mr 

0,0 

2.7 

3.0 

8.6 

4.4 

1.9 

P. 

10.3 

3.3 

3.1 

20.2 

7.5 

2.7 

Pi 

12.4 

3.3 

3.8 

10.4 

5.2 

2.0 

S, 

12,0 

3.G 

3.0 

17.8 

6.0 

3.0 

M. 

0,1 

'2.8 

3.3 

11.1 

4.4 

2.5 


* Difference ia first of a pair from second; hence, minus signs may occur. 


Table 7 

Comparison of psychoneurosia, severe (P,), and the clinical group of paychoaia (P,y) on 
tho separate Multiplmsic Invcntoi^y scales showing difference, standard 
error of differenco and critical ratio of T-scorea* 


n, 04 

n, 13 


p.-p.. 


Dif. 

SEdif, 

D/SEiii/. 

? 

- .3 

.9 

3 

L 

,6 

1.9 

,3 

F 

2.1 

3.2 

.7 

II. 

-6.7 

4.0 

1.2 

D 

1.4 

8.1 

.2 

11, 

-8.7 

5.9 

1.5 

P.I 

ai 

0.8 

.5 

Mj 

-1.0 

4.4 

.2 

P. 

0.9 

7,1 

1,4 

Pi 

-1.0 

4.6 

.2 

s. 

4.0 

5.5 

.9 

M, 

2,0 

4.0 

.5 


* Difference ia first of a pair from second; hence, minus signs may occur. 
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Tabic G 


Compariaon of pHychoneurosiH, mild and tho clinical groups of psycho neuroaia, 
severo (1\), and psychosiB (P.j,) on the Bcpnrato Mnltiphnaic Inventory scalca 
showing difference, atanclard error of differcnco and critical ratio of T-scoreg* 


Pr. 

n,2(l 

P, 

n, Od 

P-v 

n, 13 


-.jf 





Dif. 


D/SR.,i,. 

Dif. 

SEclIf, 

D/SEa„. 

? 

-.8 

1.3 

.0 

-1.1 

1.4 

.8 

L 

,2 

.9 

.2 

.B 

2.1 

.4 

F 

4.0 

2.0 

2,0 

0.1 

3.4 

1.8 

n. 

11.4 

3.7 

3.1 

4.7 

5.5 

.9 

D 

20.1 

4.9 

4.1 

21.5 

8.7 

2.5 

Hy 

12,7 

4.3 

3.0 

4.0 

6.8 

.6 

Pd 

13.1 

3.0 

3.6 

16.2 

7.1 

2.3 

M( 

0.6 

2.7 

3,0 

8,6 

4,4 

1,0 

P. 

10.3 

3.3 

3.1 

20.2 

7.5 

2.7 

Pi 

12.4 

3.3 

3.8 

10.4 

5.2 

2.0 

So 

12.0 

3.fl 

3.0 

17.B 

5.0 

3.0 


0.1 

• 2.8 

3.3 

11.1 

4.4 

2.5 


* DifTcrence ifl first of a pair from second; hoiico, minus signs may occur. 


Table 7 

Comparison of psychonourosia, severo (Pj), and tho clinical group of psychosis on 
tlie separate Multiphosic Invontoiy scales showing difference, standard 
error of di (Terence and critical ratio of T-scores* 


i tv 

n, 13 

Dif. 

SKdii. 


? 

- ,3 

.9 

-3 

L 

,0 

1.9 

.3 

F 

2.1 

3.2 

.7 

n. 

-5,7 

4.9 

1.2 

D 

1.4 

8.1 

.2 

Ily 

-8.7 

5.0 

1.5 

Pd 

3.1 

G.8 

.5 

M, 

-1.0 

4.4 

.2 

l\ 

9.9 

7.1 

1.4 

Pt 

-1.0 

4.0 

.2 

Sc 

4.0 

5.5 

.0 

M, 

2.0 

4.0 

.5 


Difference is first of a pair from second; hence, minus signs may occur. 
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(e) The Pa curve ahowa a high plateau, 3 sigmas above normal at hypo- 
clionclrioaifi-depresBion-hysteria (depression slightly higher), drops iit mnscii- 
hnity-femlumity, and rises again to Bchwophveiiia; , „ - 

(/) The P,y profile shows n high peak on dcprcsaion at 3 sigmna above 
normal, a descending to masculinity-femininity to nearly normal, a sharp rise 
(2.5 sigmas) to paranoia, a alight drop at psychasthenin and a rise to nearly 
3 sigmas at schizophrenia. 

There is ft decrease on all profiles on the hypomania scale. 

Of the validating indicators, ?, L and F, Lhe curve rises more sharply 
at F for the Pay group and has minimal accentuation for No. 

From examination of Table 3, where the No group is compared with 
the clmical groups, Cp, Cn, P, and it will be noted that in all 
but 6 instances a significant difference is apparent, the critical ratio being 
3,1 or higher — ranging from 3,1 for No-Cii on the Pd scale to 15,5 for 
No-Pa on the Hy scale.® Of the 6 cases that diverge, 4 are in the No-Pm 
comparison on the psychopathic deviate, masculinity-femininity, para- 
noid and psychasthenic scales, with critical ratios of 1.9, .7, 1.7 and .9 
respectively. The remaining 2 are on the masculinity-femininity scale 
for No-Cpmd Nd-Pm critical ratios of 2.8 and 2.6 veapcctivcly. 

In the matter of the validating items of 7, L and F scales, no signifi- 
cant differences appear on the ? scale, although between No-Cii tire 
critical ratio is 2.0, the No group having the higher 7 score. On the L 
scale, the only difference possessing significance is that between No-Cn, 
where the critical ratio ia 7.0, and where again the No group makes the 
higher score. The F scale shows significant differences in 3 of the com- 
parisons, and borderline significance in the remaining 2. In each in- 
stance the greater F score is made by the clinical group, The critical 
ratios in ascending order are respectively: No-Citf 2.6; No-Cp, 3.1 ; No-P,y, 
3.6, and No-P^j 6.7. 

Table 4 compares the Cp group with the other clinical groups. In 
only 2 instances here are there significant differences : the L scale has a 
critical ratio of 3.1 for the Cp score being the higher; and the 

critical ratio for Cp-Prn on hypomania is 3.7, the Cp score being higher. 
Approaching significance is the critical ratio of 2.4 for Cp-Cu on the 
masculinity-femininity scale, the Ch group being the higher; Cp-P^ on 
the psychopathic deviate scale shows a critical ratio of 2,9, the Cp group 
being higher; and on the paranoid scale, Cp-P^, the critical ratio is 2.9, 
Cp being the higher. 

Table 5 compares the Cu group with the clinical groups P, imcl 
In the validating scales, only the L score for C//-P, shows a differ- 
ence that is significant — the critical ratio is 3,8, with Cn being higher. 

^ In this and succeeding disciisgion of sigiiificnuco. a critical ratio of 3.0 Is taken as 
the eriterioa for significance. 
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On the masculiiiity^einiiiinity and piimnoia scales for and 

hypochondi’irusiH on Cn-Pg thc5 critical ratios are respectively 3.6, 3.7 and 

3.1, with Cii liiglier in the first 2 instances, and the lower score in the 

latter. Tliose are the only Hignificant diffciences here; but noteworthy 
are: critical ratios of 2..'5 and 2,() for on the schizophrenia and 

liypornanic scales nispectively, with On in each case the higher score; in 
tlic C}i-Pi comparison we find the respective critical ratios of 2.6 and 
2.2 on the ttcules for de])ression and masculinity-femininity, with the P, 
score lughcr on the dei)r(j»SHi()n seiUc, and Cn higher on tlic masculinity- 
femininity scale; while for Ca-Pty on tlic masculinity-femininity scale the 
critical ratio is 2,1, C'// being the higher score. 

Table 0 compares the Pm group with the P, and Pay groups. In 
every instance on the main scales the higlicv score is made by the more 
disturbed group. Significant dilTerenccs are seen in the P,n-Pa compari- 
son on all scales, the critical ratio.s being respectively 3.1, 4.1, 3.0, 3.G, 

3.1, 3.8, 3.0 and 3,3 for Ijypochonclriasia, depression, hysteria, psycho- 
patliic deviate, masculinity-femininity, paranoia, psychasthenia, schizo- 
phrenia, aiid hypomnnia. 

In tlic comparison of P»-Pai/, only on the schizophrenia scale is a 
significant difference apparent, the critical ratio being 3.0, with P«y the 
higher score; but to be noted are the critical ratios of 2.5, 2.3, 2.7, 2,0 
and 2,5 on the scales for depression, psychopathic deviate, paninoia^ 
psycliustlicnia and hypomnnia respcctively—all scores being higher 
for P,y. 

Table 7 comjnwes the Pa-I\y clinical groups, where no significant 
differences can be observed. However, it is interesting bo note that the 
trend is for tlic Pg group to score higher on the scales for hypochondriasis, 
hysteria, masculinity-femininity, and p.sychasthenia; while the Pay group 
is the higher on the scales for depression, psychopathic deviate, paranoia, 
schizophrenia and hypomania. 


Summary 

As indicated earlier this is not an experiment in the usual laboratory 
sense; yet, every elToj’t ^ra.s made to maintain standard conditions for all 
groups and to prevent the intrusion of uncontrollable variables or artifact. 
The value of the MulLiphasic Inventory as a predictive instrument and 
clinical tool depends upon its agreement with the clinical diagnoses. 
This is, of course, open to many pit-falls: the lack of a common psychi- 
atric language; the lack of dcar-ciit clinical criteria for identifying 
personality abnormalities; the failure of an individual undci' study to 
present imcomplicated symptcniH or to present crystallized behavior 
patterns; the lack of time for making a prolonged study of the individual. 
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This explains to an extent the lack of greater definiteness in the diag^ 
nos tic groups employed here* No attempt has been made to define the 
groups beyond the major classifications. Since a clinical evaluation had 
to be made with the minimum expenditure of time consistent with good 
procedure, and since verification of the clinical diagnoses was generally 
impracticable, greater preciaion here would not mean neccsBanly sub- 
stantiation in fact or in composite psychiatric or psychological opinion. 
Table 8 shows the recommendations made and the actual disposition on 
the 121 cases of this study. This ia purely pragmatic. It must be borne 
in mind that final disposition of these caaes rested mth a board of medical 
or line officers, few of whom had any genuine training in psychology or 
psychiatry. Yet, this subjective Bystem was in agreement with the 
clinical psychological-psychiatric findings minimally at 62.8%; 41.3% 
were discharged; 17.4% were placed on a limited duty status, and 4.1% 
were sent to a general hospital for further observation and disposition. 
The follow-up data are deficient in 29.8% of the cases studied. These 
men were returned to duty, but the percentages could not be ascertained 
as to which were for full duty and which for limited status. All of the 
psychiatrists making diagnoses were qualified neuropsychiatrists. Two 
of them were fellows in the American Psychiatric Association. Three of 
these showed little or no interest in the Inventory (or any psychometrics 
beyond intelligence examinations); the fourth neuropaychiatrist who had 
been on duty at the Conaultatiou Service was definitely iute vested in the 
Inventory but purposely refrained from consulting it until after he had 
made a clinical evaluation. 

The several profiles of Figures 1-5, and Tables 3-7 indicate the agree- 
ment of the test with the clinical findings and point out its potentialities 
us an aid in differential diagnosis. Objective comparison of the diagnostic 
groups with a normal group has demonstrated statistically significant 
differentiations (Table 3). Even between the diagnostic groups, one 
finds distinctive and valid differences (Tables 4-6), typifying, or peculiar, 
to a general class of disorder or diagnostic group. Thus, the depression 
scale appears as an indicator of the seriousness of the disintegration; being 
lower than both hypochondriasis and hyaleria in the psychopathic group 
and mild neurotics, and higher in the severe neurotic and psychotic groups. 

The lack of statistical significance betwpen the P, group and the Pjry 
group (Table 7) may be due to the small number of cases in the Pay 
group and its large standard deviations. Qualitatively, however, the 
profiles are different (Figs. 4 and 6). It is to be noted that the peaks 
for hypochondriasis, hysteria and psychasthenia are more pronounced 
than the other scales for the P« group; while, in the Pay profile the peaks 
are for depression, paranoia and schizophrenia. 
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Hecommeiided. Action and Final Disposition of th.e C^j -Pij and Groups 
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The more probable explanation for the appavciitly elose relationship 
between these groups (and also between C^-P ^i/ancl m the rtoss- 

ness or overallness of the classifications used here together with the 
generally non-crystallized reaction types. 

That the test is sensitive is fiirtlier suggested in the JV« group. The 
profile for this group is generally slightly below tlic T-scoro moan of 50. 
but has a peak on the paranoia scale. In terms of its own goslalt, this 
would indicate a slight reduction in affect and a slight fixation of ideas. 
When one considers (cf. Table 1) that this group 1ms been in the Service 
somewhat longer than the clinical groups and that they have met with 
more success (attained higher ranks) than the other groups, one is in> 
trigued by the profile. It is essentially stable and e.s.scntially normal. 
Yetj it does differ from the expected T-score average and from tlie normal 
profile as found by Levevenz (8) . Could this l)e the healthy, experienced 
soldier’s profile — phlegmatic and purposeful — or has there developed in 
this group a subtle personality alteration? 

Provocative, too, of further investigation in the group are the 
slightly elevated L and F scores. Has this group learned to jnit its bo.st 
foot forward, but within affectively controlled limits, and at the same 
time has it become possessed with an idea, lias it a singleness of purpose? 

Conclusion 

The purpose of this paper has been to present some findings on the 
use of the Minnesota Multiphasic Personality Inventory in a clinical 
situation. The cases were all male white enlisted men of the Air Force 
who had been studied at the Consultation Service of a personnel replace^ 
ment pool. Of the cases seen, 98 were problems solely of administration 
and became the normal group, A total of 121 cases was seen because 
of maladjustment to the Army situation and these were subsequently 
diagnosed through standard practices by qualified neuropsychiatrists os 
either: constitutional psychopathic state, inadequate personality; con- 
stitutional psychopathic state, sexual psychopathy; psychonourosis, mild; 
psychoneuvosis, severe, or psychosis. Diagnose.s were made independ- 
ently of the Inventory. The data thus gathered indicate that the Multi- 
phasic Inventory did in this empirical situation: 

1. Diatinguish graphically and with statistical significance between 
normal soldiers and those diagnosed as constitutional psychopaths; mild 
or severe neurosis; and psychosis. 

2. Differentiate with significance between major clinical groiip.s. 

3. Present qualitative differentials, or hints for clinical cpiery, in the 
more disintegrated or anomalous personality disorders. 

The data are in agreement with Leverenz’ (8) observation that 
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althougli clinical iinpicj^Hion may not be corroborated always by the 
scores, the clinician in made aware of one or more pcraonality abnormali- 
tica that rcciuire evaluation. 

Rccemd October 2, tOU. 
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Use of the Minnesota Multiphasic Personality Inventory 
in Vocational Advisement* 

Lindsey R. Harmon and Daniel N. Wiener 

Veterans Adminisirotjon, Minneopolis, Jlfmncaola 

At each of the 53 regional offices of the Vetemns Administration the 
Advisement and Guidance Subdivision iii the Vocational Rehabilitatioit 
and Education Division determines the need for rehabilitation of disabled 
veterans and provides vocational counseling services leading to the selec- 
tion of appropriate employment objectives. The work of rehabilitation, 
including advisement and training, is conducted in accordance with 
inatructione developed by the Central Office of the Vetevaua Administra- 
tion in Washington, D. C,, to effectuate the provisions of Public Law 
No. 16, 78th Congress, as amended. Tlio vocational advisers in the 
Subdivision use army or navy records, case histories, interviews, and 
vocational information for their contributions to an appropriate voca- 
tional choice. In addition, the results of valid, reliable, and well- 
standardized tests play a considerable role in the advisement, and arc 
administered as deemed necessary in tire advisement process. This ad- 
visement process has been described by Brophy and Long (1). 

At the Minneapolis facility, the Advisement and Guidance Subdivi- 
sion uses an extensive test battery which includes the Minnesota Multi- 
phasic Personality Inventory as a measure of personality. The need for 
a personality test in vocational advisement is recognized as particularly 
acute since over halt of the medical discharges from our armed forces 
have been for neuropsychiatrie disorders. However, these disorders liave 
been diagnosed only within the unique and tense framework of life in the 
armed forces and need to be related to the framework of civilian society. 
The Minnesota Multiphasic Personality Inventory was included in the 
personality measurea because it appeared well standardized in terms of 
various clinical categories that could be related to vocational fields. 

After a preliminary interview in which the provisions of the law and 
the regulations concerning vocational rehabilitation are explained to him, 
the veteran is assigned to an adviser who interviews him in order to 

* Special aoknowledgcnonts arc duo to the Vetarana Adminiatration wWioli haa fur- 
nished the data for this article, and to the ofReials of the Veterans Administration whoso 
critioiams hove been invaluable in its propatation. However, tho authora nssuine sole 
roaponsibilily for the opinions expressed. 
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complete a comprehensive survey of hia background. On the basis of 
this interview, the adviser indicates on a worksheet the appropriate tests 
to be adminiaterecl by the paychometriat. The Minnesota Multiphaaic 
Poiflonality Inventory is usually indicated. Tho veteran then hegina his 
testing. When it is done, lie returns to his adviser who discuasea employ- 
ment objectives with him on the basis of the records, the previous inter- 
view, and the test results. 

The elements that comprise a counseling interview form a complicated 
pattern from which it is difficult to i.solatc for evaluation specific kinds 
of data. However, it is apparent in many cases that a test result, a 
physical or mental disability, an aspiration, or a family ambition, indi- 
cates BO important a characteristic of the individuals behavior that it 
dominates the interview and the choice of the employment objective- 
Traits bearing this relation to the choice of nn occupation are not infre- 
quently revealed by the Minnesota Multiphaaic Personality Invenfcoiy, 
even when no single scale is sufficiently elevated to indicate a clinical 
abnormality. Consideration of tho several scales of this test and their 
use in tho advisement of veterans in the Minneapolis office of the Vet- 
erans Administration during the first several months of the rehabilitation 
program will serve to illustrate the usefulness of the Multiphnsic Inven- 
tory in this program. 

The summary of interpretations and uses of the inventory in voca- 
tional counseling that follows is offered as the accumulated experience 
of the Rehabilitation and Education Division of the Minneapolis office 
of the Veterans Administration. It is the outgrowth of clinical experience 
rather than the statistical results of controlled experiments. It is hoped 
that experimental data may soon become available; pending such results, 
it is felt that these interpretations may servo as a useful guide in the 
employment of the tG.st. 


Use of the Scales 

Elevation on the scales of Hypochondriasis, Depression, and Hysteria 
has occurred more frequently than on the other scales of this test. Such 
elevations often indicate severe limitations on the kinds of work a man is 
willing to undertake, most frequently eliminating dirty or heavy jobs. 
Also, it often indicates the desirability of a job at the lower end of the 
ability level, where a minimum of stress will be encountered; and 
tho avoidance of such high-pressure cccupations as selling, investiga- 
tional, or promotional work. Similarly, when Paranoia and Schizo- 
phrenia scales are elevated, the relatively routine, well-regulated job ia 
preferable to work requiring initiative, self-discipline and social contact, 
as these functions are particularly difficult for those with this withdrawn 
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type of personality. By contrast, elevation on the Psychopathic Deviate 
and Hypomanlc scales indicates the type of personality most likely to 
adjust in jobs of a relatively undisciplined nature, where individual 
initiative and aggressiveness are at a premiiiin, and which afford a maxi- 
mum of variety in work processes, locale, or associates. 

Elevation on the scales indicative of paranoia, psychasthenia and 
schizophrenia has been encountered less frequently than on the other 
scales. When elevation on these three psychotic scales docs occur, a leas 
favorable prognosis of vocational success is indicated limn would accom- 
pany elevation on the other six aqalea. A simplified program of training 
and employment appears advisable, with avoidance of occupations where 
the skillful maintenance of social relations is an important factor in 
success. Outstanding in such personalities are the less desirable, less 
utilizable forms of adjustment than may be associated ^Yith elevations 
on the other scales. Hypochondriacs, depressives, and hysterics show 
symptoms with which associates may sympathise; in the psychopathic 
deviates and hypomaniacs the deviations may be self-compensating or 
even rewarding in certain occupations; the effeminate man may be the 
best-adjusted one in a number of professions. But the paranoid, schizo- 
phrenic and psychasthenic forms of adjustment have no apparent advan- 
tages or compensations to balance the disapproval and penalties lliat are 
placed upon them. These adjustment-patterns appear to bo obstacles 
to success in practically all occupations and require the poorest prognosis 
of vocational success. 

The Masculinity-Pemininity score is often the most difficult to inter- 
pret. It is sometimes depressed considerably below obvious manifesta- 
tions of effeminate behavior and interests, and it is often high without 
any overt manifestations or expressed interests to confirm it or give it 
significance in terms of vocational advisement. There may be a dichot- 
omy between feminine interests that can be acceptably and even success- 
fully related to social relationships and occupational fields, and femininity 
or inversion of a socially unacceptable nature. In spite of these inter- 
pretative difficulties, this scale ia frequently a useful guide to the coun- 
seling interview, indicating aesthetic propensities that can be related 
directly to a vocational field, or on effeminacy that contra-indicates 
vocational fields where tough-mindedness is desirable. 

Test Battery Employed 

In Older to illustrate a few of the many ways in which the Multi phasic 
Inventory has proved useful in vocational advisement, a brief description 
of the test battery of which the Multiphasic Inventory is a part will be 
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presented, nnd cose hintories will be examined. Each case is purposely 
Bclectccl to i)o typical of a ri-ou)) of cases; niiique or spectacular illustrtt- 
tions have l)cen avoided. AUhougli the Multiphasic results are described 
more fully hero than is tlic information provided by the other tests, the 
latter must not be and have not been overlooked in coimsellng, 

The test battery that was administered to the casas to be described 
was as follows: Academic ability; Unit Scales of Aptitude, Vocabulary 
and Analogies, Otis Helf-Admiinstcring Tests of Mental Ability, and the 
Ohio State Uuiveisity Psychological Test, Form 21, for college ability. 
Clerical apliluclc: Mimicsota Vocational Teat for Clerical Workers. 
Mechanical aj)tiUule; Revised Minnesota Paper Form Board Teat, 
Minnesota Spatial Relations Test. Manual dexterity: Minnesota Rate 
of Manipulation and O^Connor Test of Finger and Tweezer Dexterity. 
Vocational preferences: Kudev Preference Record, Strong Vocational 
Interest Blank for Men (Rev.). Pcjaonality: Miiuiesota Multiphasic 
Personality Inventory, All norma arc in terms of general late adolescent 
or adult populations, except where otherwise specified. 

Scores, when given, arc standard scores, except for the Kuder Prefer- 
ence Record which is in percentiles. The abbreviations used in zeporting 
the Minnc.sota Multiphasic Personality Invcntorj^ scores are: ?, Cannot 
Say; L, Lie; F; Validity; IIs, IIypoclioiidriafli,s; D, Depression; Hy, Hys- 
teria; Pd, Psychopathic-Doviale; Mf, Masculinity, Femininity; Pa, Para- 
noia; Pt, PaychustliGiua; Sc, Schizophrenia; Ma, Hypoinania. For de- 
tailed information on the Minnesota Multiphasic Personality Inventory 
see references in the bibliography. 

IJliiatrative Cases 

Z/. S. This high school graduate is 22 and aingle. He had been in 
the Navy for 4 months, 3 months in training to be a radio operator, and 
1 month in the hospital for serious delusions, depression, and anxiety. 
He was discharged for psychoncurosis rated 10% disabling. He applied 
for rehabilitation because his present work as a shipping clerk does not 
challenge him or offer a future, because he docs not have the ^‘back- 
ground or amount of confidence" to lit him for other work, and because 
he cannot do work “calling for quick thinking or courage." He primarily 
wants to train for a career in music, secondarily to manage an auto parts 
or some other business. Ho states, ‘T think my will can overcome the 
difficulties" which might interfere with success. 

On all testa but two, hi,s academic, mechanical, clerical, and manual 
abilities and aptitudes are well above average. His highest points are 
the clerical tests, at the 99th and 97th percentiles. His preferences are 
for literary and musical work, with the Clerical-Computational pattern 
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eecoudary. The Multiphaaic Personality Inventory scores arc: 7 50, 

L 50, F 80, Hs 65, D 70, Hy 67, Pd 86, Ui 98, Pa 67, Ft 92, Sc 99, Ma 63. 

This man waa completely ineffectual in the interview situation. Ho 
looked down at the Boor continuously, would respond only minimally and 
in a whiaper, and was entirely amenable and Buggoatiblc to the adviser's 
words. He used abstract terminolbgy, showed no aggressiveness, and in 
general lacked orientation to the real world. The Multiplmsic Person^ 
ality Inventory revealed enough extreme psychotic tendencies to warrant 
hospitalization at worst, and at beat, an employment objective of low 
enough level to place him under minimal streaa, yet respectable and dean 
enough to avoid irritating him with iba physical demands. 

There was no evidence of musical ability except for expressed interest 
in Bong writing. He showed some appreciation of the difficulties involved 
in making a living in the field of music, and the desirability of being able 
to earn a living in a more stable field. Bookkeeping appeared fco meet 
his needs and abilities best and was entered as his objective. Aa soon 
as possible, this man should be referred for psychiatric aid. The strong 
schizophrenic trend indicated by the Multiphasic Personality Inventoiy 
and the interview situation make continuing success in any employment 
objective doubtful, although he is doing excellent work in his training 
at present 

J. M, This 22 year old veteran is a high ecliool graduate. He came 
in to apply for rehabilitation because he was not qualified for any akilled 
job, and his present work, being unskilled, offered no future security. 
He had no expressed vocational preferences except for ‘*desk work’* which 
He “could do even if (he) didn't want to." His disability rendered his 
left arm useless for moderate or great muscular exertion. 

His academic ability was above the average of the general population 
but below the average of college freshmen; his mechanical aptitude and 
manual dexterities were generally above average. His tested preferences 
were for persuasive, artistic, and literary work. The Minnesota Multi- 
phasic Inventory scores were: ? 50, L 50, F 65, Ha 65, D 53, Hy 60, Pd 50, 
Mt 69, Pa 50, Pt 66, Sc 67, Ma 68, 

The firat interview had revealed no evidence of the deviate person- 
ality tendencies which were later indicated by the Multiphasic. After 
the Multiphasic results were available, however, he waa questioned more 
closely about his training, experience, and interests, in an attempt to 
discover the significaiiGe of the elevation in Mf. The Preference llecord 
waa also available, indicating literary and artistic interests, which were 
associated with his Mf score. 

The second interview revealed not only some artistic interest, but 
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actual commercial art Hchool iraining aud extensive spare time work at 
cartooning. He wan reluctant to mention this background, he said, be- 
cause ho had been unable to (inisli paying the nrfc school. The adviser^a 
impression was that he also wanted to avoid appearing effeminate or 
artistic. 

Ho later l)rouglit in J}is woik and it judged favorably by a com- 
mercial artist. To objectives suggested before he mentioned his art 
work, he had raiscQl minor ol)jecU(mHi later when an objective in art was 
suggested, he Bhowed considerable relief. He was entered into training 
as a commercial artist where he is very happy and conscientious with hia 
work. His chances for aucceaa appear excellent. 

J,J. J. J. is a 29 year old man, with ninth grade education, He 
was a cook in tho army and hag a long work record that includes a variety 
of eemi-akillcd and unakillcd jobs mainly on farms and in lumber campa. 
He feels he needs schooling to qualify for light work which he has been 
told ia all he can liandlo now, and considers hia present job as a Railroad 
Ashman too insecure. His rated disability is valvular heart disease, 
80% disabling; ho is in the claas of heart disease ranked next to the com- 
pletely bedridden on a five point scale, 

Test roflults indicate a man of low academic ability, average clerical 
ability, and high mechanical aptitude and manual dexterities. Hia tested 
prefci'oncos are for mechanical and artistic work, with the clerical field 
secondary. The Multipliasic Inventory scores were: ? 50, L 70, P 60, 
Hs 53, D 70, Hy 75, Pd 47, Mf 51, Pa 41, Pt 39, Sc 40; Ma 43. 

High point on the Multipliasic was Hysteria, with the Lie score and 
Depreaaion also elevated. During the interview this veteran showed 
considerable concern about getting a ''good deal,'' particularly looking 
for security. Ilia only objection to his present work was that it wag too 
insecure; actually it is heavy worlc that he should not be able to do if his 
disability were purely organic. This evidence together with the Multi- 
phasic Inventory evidence prompted a diacussion with the cardiologist in 
which he stated that the disability was probably not as bad as rated on 
the baeiB of the evident organic symptoms. 

With this information, the advisement was subject to less limitation 
and it was possible to discuss with the veteran a fairly broad range of jobs 
in the mechanical field that involved up to a moderate amount of physical 
activity, The objective agreed upon was that of office machine service- 
man involving a moderate amount of physical exertion which was not 
originally considered medically feasible. 

There was considerable evidence of emotional disturbance in this 
man's frequent job changes, his indecision about what occupation he now 
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wants to enter, the incompatibility of hi« prcKeut work and his disability, 
and his desire for education without specific reason. The Ily, I) and L 
scores of the MuHiphasic Inventory ^Yevc vnUialile indicators of the form 
of his mal adjustment. 

J, (?, This 20 year old unmarried veteran left seliool wliib in the 
tenth grade, joining tho Navy as a fireman to begin what Im planned to 
be a Navy career. He was discharged with pulmonary iulxuoulosls for 
which he receives maximum compensation. He l)cgan his /ulviscniGnt 
veiy certain that he wanted only to bo a bookkeeper, and stated that lie 
saw no use in the testing and advisement for him ns lio knew wliafc lie 
wanted and would fight until he got it. 

Test results revealed above average academie aidlifcy, higli mechanical 
aptitude and somewhat above average manual dexterities. On the cleri- 
cal tests, he scored at the 9 th percentile on NiimbeVvS and at the 31at 
percentile on Names. His interests were Computation al-Clcrical pri- 
marily, and Mechanical and Persuasive Bccondarily. The Multiphasic 
scores werei ? 50, L 50, P 53, Hs 53, D 51, Hy 58, Pci 47, Mf 53, Pa 35, 
Pt 41, Sc 47, Ma 6S, 

Although the Ma score is not high in terms of al^solule norms, it is 
high relative to the individual pattern, and is indicative of the strongest 
characteristic in this man's behavior. ITis behavior during his liospitali- 
zation and since hia discharge confirms ll\o Ma ’score, lie practically 
forced his way out of the hospital, prematurely according to the doctors, 
and has insisted on immediate action throughout his dealings with the 
Veterans Administration, often to his di.sacl vantage. 

This veteran did not show sufficient clerical aptitude to render book- 
keeping a desirable employment objective, and the personality inventory 
was higher on overproduebivity of thought and action than one would 
associate with successful bookkeepers; nor was tlicre evidence from tlie 
background or interview, of basis for hia firm deciaion. The decisivenosa 
of his decision was a function of his personality. The interview con- 
firmed the Multiphasic Inventory, and it proved futile to attempt to find 
a rational basis for his preference, even though it was apparent that sales 
or mechanical work would be a more appropriate choice. Because of hia 
insistence, he was permitted entrance into training as a bookkeeper. 
Prognosis for success in training was doubtful, and already veporfca on hia 
progress indicate that he is ''not putting forth hia beat effort," which he 
attributes to the effect of the weather on hia hniga. 

E. M, This single, 28 year old Negro veteran auffered a foot infec- 
tion that required several months hospitalization and left him with Umi- 
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tations of motion of his foot and a need to avoid atrenuous work. Shortly 
before discharge from the Rervice ho had been removed aa platoon leader 
because of disobeying army regulabiona. 

An intelligent, pleasant man, he made an excellent first impreaaion 
which was strengthened hy the results of aptitude testa showing good 
abilities for acadenue and mechanical work. He had previous college 
training in chemistry and wished to be trained as a pharmacist. Hia 
mediocre grades in college he attributed to the fact that he was working 
several hours a day as an electricians' helper in order to support himself 
at school. His vocational preferences were in the scientific, social service 
and clerical fielda, thus fully supporting his expressed choice. 

Because he completed hia advisement early in the history of the 
program, before the administration of the Multiphasic Inventory had 
bcoome routine, this test was not given to liim. He was inducted into 
training witli no reservations except those arising from the fact that, aa 
R pharmacist, lie might have to spend too much time standing on his 
injured foot, and the further limitations on placement possibilities be- 
cause of hia race. 

Hia University grades were poor on his first examinations. It seemed 
reasonable to attribute his difficulty to the long interruption in hia college 
training. When they continued^ poor, a check with his inatructors re- 
vealed lliat lus basic preparation in chcmiatiy was poor and he did not 
fieem to bo making any progress in learning. He was referred back to 
the Advisement Subdivision with the notation that he apparently lacked 
the necessaiy mental equipment to handle college work, Concurrently, 
he came to the attention of the counseling service of the University, 
where — -in addition to re-tests of scholastic aptitude and objective meas- 
ures of achievement in academic subjects — the Multiphasic Inventory 
was given. The results were: ? 50, L 50, F 68, Ha 53, D 56, Hy 49, 
Pd 98, Mf 63, Pa 70, Pt 70, Sc 7^ Ma 70. 

A comparison of his report of hia work and actual grades showed 
numerous discrepancies, and hia reasons for poor previous achievement 
did not hold up under investigation. The clinical history, on further 
checking, yielded other data that completed the picture of a constitu- 
tional psychopathic deviate. 

The re-valuation of hivS vocational potentialities in the light of the 
above facta made it apparent that he would not be able to achieve up to 
hia mental ability because of his deficient self-diacipline and direction. 
This hnc of reasoning resulted in a down-grading of his objective from 
professional work to the skilled labor of electrical-appliance repairing, thus 
utilizing maximally his previous experience, taxing hia abilities minimally, 
and affording a fairly wide variety of activities on the job. 
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ft, S. A veteran of the South Pacific campaigiia, II. S. waa dis' 
charged for mixed psych oneuroaia, rated aa 50% disabling, and in addi- 
tion states he suffers from recurring malarial attacks. He m 24, and a 
high school graduate. His employment experience consisted of truck 
driving and helping in his father’s laundry. He feels that ho cannot 
return to any heavy work, is trained for notliing clae, and would like to 
become a Forest Ranger or a Certified Public Accountant. 

His teats show about average academic ability and clerical aptitude, 
and an erratic pattern on mechanical aptitude and inanvial dexterity 
teats, with scores more often above than below average. His tested 
preferences are for mechanical-acientifio work, witH computational work 
secondary. The Multiphasic Inventory scores are: 7 60, L 50, F CO, 
Hs 97, D 87, Hy 78, Pd 65, Mf 59, Pa 56, IH 79, Sc 76, Ma 63. 

Although he indicated a preference for forestry work, wlien discussion 
centered on specific physical demands, he stated that he could not do the 
manual work involved. His desire for it derived only from the possible 
college education involved. Neither did the idea of working alono in the 
forests appeal to him (note elevation on Pt), Mechanical work also, ho 
was afraid, would be too trying fqr him physically. In spite of only 
average clerical aptitude, he would consider only bookkeeping os an 
alternative. This was entered as his objective on the ba.sis of his ex- 
pressed interests and his personality, since it involved a nunimum of 
physical and emotional stress for him and was not strongly contra- 
iudicated. 

The primary adjustment in this advisement had to be to the veteran's 
Goneern. with his health, os the Multiphaaio Inventory indicated; D and 
Hy are concomitants of Ha, Within the one month period since he was 
asaigued to training, he had to postpone entering the program for several 
days and was absent for about four days since beginning, Ho is taking 
medicine for his throat and has complained of trouble with his eyes. 
The prognosis for his success is only fair, ivith the strong possibility that 
his extreme concern with his health will seriously interfere with hia train- 
ing and employment. 


Summary 

The Minnesota Multiphasic Persona^lity Inventory, as part of the test 
battery used in vocational diagnosis of disabled veterans applying for 
rehabilitation, has proved to be an inatrument of prime utility. It has 
served to delineate personality characteristics of crucial importance in 
the actual choice of a vocation, and has yielded valuablejinformation to 
aid in prognosis of success in training, In some instances it has revealed 
personality characteristicB that had nob previously been recognized, and 
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in others offered quniititativc confirmation of the clinical impressions of 
fl, case history and intcrvlc'v. 

It is most useful ns a part of a well-rounded advisement procedure 
including tests of vocational aptitudes, mental ability, and vocational 
intcreats, and a thorough interview and case history. Improvement of 
Bpccific scales, particularly the teats of internal validity, which are a 
unique and valuable aspect of this teat, should further enhance its value, 
Additional clinical and experimental studies of the relation of tost scores 
and patterns of scores to success in various vocations seem likely to extend 
the UBefulnes.s of this instrument in the vocational guidance clinic, but 
its practical value hn.s already been sufficiently demonstrated to justify 
its employment on a bosis of equality with tests of abilities and interests. 

Received June l/f, }0/i4. 
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First Impressions of Classmates 

Wilhelminfl E. Jacobson 

DmUpi College 

That first impressions exort an important influence in human lives 
hca long been recognized. Meeting new people, vimting strange places, 
facing unfamiliar situations, are part of the normal courfio of daily living, 
and in such circumstances first impressions arc often the only guide to 
action. Wliere they are not the sole determinants of action, they nn- 
queationahly can contribute much towards specific behavior at the time 
or at future times. When first impressions arc favorable, that is, when 
they elicit reactions anywhere from "love at first sight" to merely an 
unspecific sense of satisfaction, the natural result is acceptance or a desire 
for further acquaintance. Where the new situation takes the form of an 
interview for a job, for example, a favorable first imprc.ssion on tlie 
employer would probably have the realistic result for the prospective 
employee of getting him the position, On the other hand, a negative 
first impression, leading to rejection and inclination to avoid fui tlicr con- 
tact, would in the same situation mean failure. 

While from a practical point of view some gonornl knowledge of wliat 
tends to "make a good impression,'' or a poor one, is daily put to use in 
business and social relationships, yet very little is known specifically 
about first jmpregsiong. A study of their nature would therefore seem 
to be of considerable value, not only for its practical application, but for 
its value in helping to understand human behavior in general. 

The college campus at the opening of the school year presented what 
appeared to be worth-while means of studying the nature of first im- 
pressiona. A freshman class had just arrived. The setting was new, and 
first impressions during the early weeks of adjustment were discoverable 
in the choice of friends and of clubs, and the ease or difficulty of orienta- 
tion to the college routine. Since social patterns are quickly set in new 
situations, the impressions of these early weeks were to have their influ- 
ence, in all probability, on the entire school career of these students. 

The writer had worked out, on a former occasion, a method for study- 
ing first impressions as a means of facilitating the orientation of a fre.sh- 
man Clothing avd Seheiion class. Her own first .irapresHions of the 
students as a group had been varied. To her they seemed hopeful, 
expectant, bewildered. As new studenta, their clothes, hair dress, and 
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make-up were Koinewhat different from the campus mode. She believed 
tliat tlicso stu denis would be n)>le to derive most benefit from the course 
if they could see thomsclvos as otlicre saw them and if they could Icarii 
to *'take it.” 

It seemed tliat a techniciuc used with success in one class might have 
value for the PerHonne! Department. As a rcaiilt^ four weeks after the 
opening of the term the i)rcscnt study, with 258 students in the freshman 
College Problems class as participants, was under takoii. 

The Problem 

The desire for approval, or to be accepted socially by one's associates, 
is a natural tendency of human beings. But what are the factors that 
cause one person to I)c accepted and another to be rejected? What 
must one be or do to be accepted by others? This study represents an 
attempt to explore this problem by the following two main lines of 
investigation: 

I. Dotennining the extent of favornblencss of the impressioris made 
by freshman girls upon tlieir classmates; 11. Determining the nature of 
first improssio]is. In ibis idmse of tlie study, two questions suggested 
themselves: A. What factors are involved? B. What influence do the 
observer's own characteristics have on her observations? 

It was found that 22% of the 258 participants in the study had some 
degree of acquaintanceship with oblicra in the class, ranging from ^'slight” 
to "being a friend.” It seemed desirable to retain the data secured for 
this group and to see if they would reveal interesting comparisons be- 
tween first impressions and impressions influenced by acquaintance. 

The Group Studied. The subjects were women students in the College 
Problems class for freshmen at Ohio University. Of the 430 members 
of the class, 401 served as both observers (those who gave their responses) 
and as subjects (those about whom the responses were made) in tlie 
experiment. Twenty-two members helped to conduct the experiment; 
seven were absent. The subjects were typical college freshmen, women 
who came from various sections of the United States, but mostly from 
towns and farms of the state of Ohio. 

Procedure^ In a study of first impressions it is necessary that the 
subjects have no acquaintance with one another, or that their acquaint- 
ance be so slight as to be negligible. The 430 students were divided into 
18 groups of approximately 24 students each. Twenty-two of the experi- 
menter’s college class in Clothing and Selection were put in one special 
group because they were to assist in the experiment. The group.s were 
made up by choosing every seventeenth student from the alphabetically 
arranged roll. This was done in order to avoid acquaintanceships that 
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the girls might have formed hy sitting next to one another in classes 
during the five weeks since the opening of the term. Each group mot 
from 11;00 to 11:50 o'clock in separate dassrooma in two of the college 
buildings. The Dean of Women, wlio taught the weekly College Prob-^ 
lema class as one unit, had told the girls in advance that they would meet 
that day in small groups. They were not informed ns to the nature of 
this meeting, but were told to bring pencils as they would be asked to 
write. In this way the results obtained would be a cross section of 
student impressions on the campus on that particular day and at that 
hour. 

Tile 22 students ' who had been selected to help with the experiment 
were trained for their jobs in their regular twodiour laboratory period 
from 8:00 to 10:00 of the same day. During this period they were told 
for the first time the nature of the experiment to be conducted in the 
College Problems class that day, and were asked if they cared to assist. 
All volunteered. Each girl was assigned to a group; in five cases tivo 
students were assigned to a group,^ 

Three graduate students who were student deans also assisted in the 
experiment. Each student dean was assigned to one floor where the 
groups were assembled, to aid the student assistants if they needed help 
and to give eiicouragement. Each student assistant had the following 
materials; 1, A list of the names and special numbers of the 24 girls in 
her group; 2. Twenty-four packs of 3 X 5 index cards, 24 in each pack; 
3. Typed directions (to be memorized); and 4. A watch with a second- 
hand, or a stop-watch. 

The assistants were told to call the roll as soon os the bell rang, and 
to distribute the cards. They then asked the class: "Would you be 
interested in knowing what 23 girls would be frank enough to say about 
you? If BO, each of you in turn will volunteer to come to the front of 
the room, state your name, and remain there while your classmates write 
down their impressions of you on these index cards." ® 

Por each subject in turn the girls at their seats took a separate card, 
wrote the subject's number in the upper right-hand corner, and one of 

^ These atudenta had been obsorverB and subjects in the First Impressions experi- 
ment the first week of fcho terni. They had sbudiecl the romarkfi made about thorn and 
were working oa improvements. They had voted 100% in favor of using the same 
technique in subsequent Clothing and Selectiion closaQa. 

* The nssignment of these atudeuta to take ohargo of particular groupa waa based on 
the experimenter'e knowledge of the studeats gained from results on tUo Bernreuter 
'Tersonaiity Inventory/* from reaulta on the Ohio State UniveTsity Payehologlcal Teat, 
and from the students' work and cooperation in the Clothing and Selection class, 

* Jennitigs says that 'fin order to secure valid data, it ia evidont that BoDiomotric 
teats must held reality value for the subjects to which they are adminiatored." Helen 
Hull Jennings, Leac/eraHp and laolahbnj p. 28, 1043. 
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the following phrases in the lower left-hand corner: (1) ''DonH know 
her/' (2) '^Know her slightly," (3) "Know her well," (4) "A friend.” 
They were then given a minute and a half in'’whiGh to list whatever re- 
marks came to their minds about the subject as she stood before them 
flt the front of the room. When every girl in the group had acted as a 
subject, the assistant asked the girls to write their own number in the 
lower right-liaiid corner of each card. The student assistants in the 
groups that finished before the end of the hour were told to instruct their 
girls to go back over their comments and to (1) place a plus (4-) sign in 
front of the comment if they meant it to be favorable, (2) place a minus 
( — ) sign if unfavorable, (3) place a zero (0) if it was in-between. Then 
each girl put a rubber band around her set of cards, after including a 
separate card on top which contained her own name and number.** All 
the cards were then collected. 


The Findings 

As each girl stood before her classmates during the experiment, she 
elicited several very definite responses from her observers in the form of 
short comments or remarks, for example, "pretty blonde hair," ^'good 
posture,*' “very kind to others," etc. At the beginning of the experiment 
the aim was to study first impressions only, but when it was found that 
a 22% acquaintanceship existed among the students, as noted before, it 
seemed worth while to study impressions more intensively. The re- 
Bponaes were therefore divided into four groups (‘‘Don't know her"; 
"Know her slightly"; "Know her well"; "A friend") according to the 
extent of acquaintanceship, t\xg term "first impreasiona" was reserved 
for one group only, the “Don't know her" group, 

A total of 258 students (or 11 of the 17 groups)® completed the experi- 
ment and are included in the study findings. They served both as ob- 
servers and as subjects. As observers they evaluated their responses as: 
+ (favorable), 0 (in-between), and — (unfavorable). The acquaintance- 
ship among these 258 students was 77% "Don't know her," 16% "Know 
her slightly," 3% "Know her well," and 3% "A friend." 

The 258 individual observers gave a total of 19,352 responses, of 
which 12,149 were favorable, 1,903 were in-between, and 5,300 were un- 
favorable. This is an average (moan) of 47 favorable, 7 in-between, 
21 unfavorable, and a total (mean) of 75 responses by each observer, 

* Tho girlfl wore told they need not sign their names on the top card if they were 
not interested in knowing what their clufismatea said about them. Of the 401 aubjeota, 
306 signed these cards. 

“ The obsorvora in eix of the groups did not have time to make tho evaluations, and 
are therefore not included in thia report. 
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Stated in percentages, tlie rcsponsca wore 03% favorable, 10% in- 
between, and 27% unfavorable. 

The observers covered a wide range in number of favova!)le and un- 
favorable responses. Where one gave only 6 favorable rcspoiiHOS, another 
gave as many as 105, or, stated in perccntagcH, one gav(j M% favorable 
responses, another 98%. The unfavorable responsen ranged from 0 to 
63 in number, or from 0% to 86%. One obHcvver gave as few as 38 
responses in all; another gave ns many ns 123. 

These results show tlmfc tlie majority of the responses wore favorable, 
the unfavorable rcaponBes being less than half the favorable. The ob- 
servers tended to be definite in their responses, that is, cither favorable 
or unfavorable rather than in-between, 

To determine the nature of these students' impiassious of their class- 
mates, a detailed study was made of five of the eleven groups® by ana- 
lyzing 9,076 responses made by the 110 girls who comprised the five 
groups, 

The study was begun by first classifying the individual remarks made 
by the observers in three of the experimental groups being analy7iCd 
(these consisted of 3,335 individual responses given by 72 observers). 
With the aid of two seniors (this provided the stiidcui interpretation of 
student responses) the individual remarLs were found to fall under 49 
Bub-topics. Many of the responses were found to havo been repeated 
several times in more or less the same way. Therefore, to facilitate 
handling, the entire 3,335 remarks were grouped under 395 dilToreiit re- 
sponses under the 49 sub-topics.'^ The 49 sub-topics then scoincd to lend 
themselves to further classification under five general calegorios : (1) phys- 
ical characteristics; (2) intelligence; (3) clothing; (4) grooming; (5) psy- 
chological factors, 

The next step was to obtain the consensus of expert opinion on the 
classifications. Four qualified members of the faculty made this evalua- 
tion; the Dean of Women, the head of tlie Department of Home Eco- 
nomics, the head of the Department of Psychology, and a member of 
the Department of Home Economics with a background in Psychology. 
They determined whether the 395 different responses belonged under the 
categories and sub-topica in which they had been placed, or elsewhere. 

" A compansoa q{ tho sclcGtcd five groups with the 11 groups with re.ypcob to mean 
Psychologicfl.! Teat Score, Bell AdjuabmeTifc Inventory Scores, Degree of Acciiiftiiitnnce, 
and nvunboT and % of rcsponsca per observer, showa that thoy approximated tho fiud- 
inga for tho eleven groups as a whole, tliorcforo making tho study of additioiiul groups 
unneceasary lor the purpose of this experiment. 

^ Many of the sub4opics used by the experimenter and tho two Boniora wore found 
to have tho same meaning as those used by Gordon W. Allporfc. In these coses, therc- 
foro, Allporb^a terminology woa accepted. Gordon W. Allporfc, Personalitv, p. 403, 
1037, 
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Following is the final clnssifieation of categories and sub-topics deter- 
mined on the basifi of these judgments, with a typical response for each 
aub-topic; 

Classification of InipreaaionR, with IVpical Hesponaes 


L Phyaical Chfinictcrlatics 

(A) Physique 

1. Hair 

2, lOyes 

a* Eyebrows 
4, Mouth 
fi. Noao 
(). Teeth 

7, Goniplexion 

8, Dimples 

9, Eigviro 

10. Heieht 

11. Weight 

12. Posture 

13. Carriage 

14. General clmractcriaticg 

15. MftRCUiinifcy-feminInifcy 

(B) Id. Health 

(C) 17. Vitality 

(D) 18. Voice 

II, Intelligence 

19. Abstract 

20. Practical 

III, Clothing 

22. Harmony of parts of costume 

23. Harmony of colors 

24. Suitability of clothes to 
person 

25. Suitability to occasion 

26. Manifestations of taste in 
clreaa 

27. Mt of dress 

28. Remarks about clothing 

29. Principles of art involved 

IV, Grooming 

30. General remarks 

31. Make-up 

32. Hair dress 

33. Shoes 

34. Nails 

36. Cleanliness 
36. Laundering 


-1- ^'Pretty blonde hair'' 

-j- “Large eyes" 

0 “Eyebrows could be thinned" 

— “Not very attractive mouth" 
+ “Cute nose" 

+ “White teeth" 

— “Too pale" 

H- “Beautiful dimples" 

4 - “Good figure" 

— “Too tall for a girl" 

0 "Should lose some weight" 

+ “Good posture" 

4- “Carries herself nicely" 

+ “Very attractive face" 

— “Boyish in appearance" 

— “Unhealthy looking" 

— “Looks worn out" 

-h “Nice voice" 


+ "Looks brilliant" 
"Looks efficient" 


— “Should not wear heels with 

ankle sox” 

— “Too many different colors" 

-b "Wears becoming clothes" 

-f "Wearing suitable school 
clothes" 

+ “Good taste in dress" 

— "Skirt doesn't fit properly" 

+ "Pretty sweater" 

— "Bow ia too large for its posi- 

tion" 

-b "Dresses neatly" 

— "Needs more make-up" 

— "Hair could be fixed differ- 

ently" 

— "Shoes could be cleaned" 

— "Too dark n shade of nail- 

polish" 

+ “She looks clean" 

— "Belt is n little soiled" 
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V. Paychological Charao tons tics 

21. Manifestations of emotions 

37. Ascendance — sub-miaaiye 

38. Expansion — reclusion 

39. PeTsistence — 

40 . Extroveraion — introv eraioii 


41. Solf'Objeotificatioii — self- 
deception 

42. Self-aasurance — self-distruBb 

43. GiegnTiouaiiess^tiUUTinissa 

44. Altruiam (aaciaUztLtion) — 
BQlf-seeking (utieocialized) 

45. Social intelligence (tact) — low 
social intelligence (tactless) 

46. Directed toward values 

47. Kadicaliatn— conservatism 

48. Observers^ likes and dislikes 
of subject 

49. General reaponflea 


— "Afraid to flinile in public" 

-p "Dominant nfc times" 

0 "QuicV' 

^ "A bit flighty" 

0 "Acta aa if aiio would be nice 
aftor you know her but seems 
to have a wall you would 
have to break through first" 

+ "Imagine she would bo sincere" 
+ "Seems rather suro of heraclf" 
+ "Yftry gt friendly" 

+ "Very kind to others" 

— "Not always tactful" 

+ "Seems serious about college" 
+ "Very conservative type" 

— "Don't think I'd like her" 

“b "A great deal of charm" 


A tabulation was then made of the 9,07G respougea of'tho 116 ob- 
serveiB. These were claBsified according to categories^ sub-topics, ob- 
eervers, favorablenesg, and extent of acquaintanceship. It was thus 
possible to study impressions from many points of view, 


What Factors are Involved in the Observers' Resiionaes? 

The groups or sub-topics under which the reaponaes were classified 
show wide vaTiation in frequency of mention, and also in extent of 
favornblenesa. Six of the 49 sub-topics constitute over 50% of the re- 
sponses: Grooming — general remarks; grooming — ^hair dresa; posture; 
emotions; self-assurance — self-distrust; altruism — self-seeking. Eighteen 
sub-topics include 93% of the responses (as indicated in Table 1). These 
18 sub-topics also include 1% or over of the total of 9,076 responses, 
The remaining 31 sub-topics consist of lesg than 1% each. 

The sub-topic of greatest frequency concerned general remarks on 
grooming, pertaining mainly to neatness. These general remarks and 
remarks on hair dress (second in frequency) cover 23.7% of all responses; 
when posture (which is third) is added, they make up 33.9%, or one-third 
of all the responses. Add the next three sub-topics — emotioti, self- 
assurance — seh-dis trust, and altruism — Bclf-sceklng, and over 50% of all 
the responses are covered. 

The five sub-topics which ronk highest in favorable reaponees arc; 
1, hair; 2, eyes; 3, altruism — self-seeking; 4, general physical remarks; 
and 5, taste in dress. For each one of the sub-topics the favorable 
responses were over 86%. 
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Table 1 


Number aud Porcentafio Diatribulion of fcho 18 Highest Ranking SubTopics 


lUink 

No. 

Sub-topics 

Rcflponaea 

Evaluotion of 
Reaponaeg in 
Per Cent 

No. 

%of 

(0,070) 

Item 

+ 

0 

- 

1 

30 

Grooming — Rcnornl romarkfl 

1,224 

13,6 

82 

4 

14 

2.C 

32 

Grooming — Imir dresa 

929 

10.2 

47 

10 

43 

2.5 

12 

Posfcuro 

020 

10.2 

51 

14 

35 

4 

21 

Emotions 

797 

8.8 

04 

0 

27 

6 

42 

Bel f-Rsaurance— -Bcl f-distrue t 

682 

0.4 

13 

27 

60 

6 

44 

Altruism — fiolf-6ockbg 

620 

5.8 

89 

3 

8 

7 

43 

Gregariousneas— Bol itarin&es 

600 

6.G 

81 

6 

13 

8 

20 

Toato in dress 

432 

4.8 

87 

6 

7 

9 

14 

General charncteristicB— physical 

413 

4.6 

88 

7 

6 

10 

31 

Grooming — makts-up 

378 

4.2 

17 

12 

71 

U 

26 

Clotlung — suitability to occasion 

240 

2.6 

72 

3 

25 

12 

23 

Clothing — harraony of color 

236 

2.6 

67 

4 

39 

13 

1 

Physical charactcristics^hair 

230 

2.6 

97 

1 

2 

14 

24 

Suitability of clothca to person 

104 

2.1 

41 

5 

54 

16 

7 

Phy a ical — complex ion 

182 

2.0 

74 

10 

16 

16 

2 

Eyes 

145 

1.6 

06 

0 

5 

17 

22 

Clothing — harmony of parts 

139 

1.6 

31 

5 

64 

18 

28 

Remarks about clothing 

116 

1.3 

83 

8 

0 



Total 8,100 

90.3 





When an analyaia is made of the unfavorable remarks, ifc is obvious 
that four sub-topics — make-up, harmony of parts of coatume, self- 
aaaurance — self-distrust, suitability of clothes to person — rank highest in 
that order, and all are over 50% of the responses in each sub-topic. 

The procedure in this experiment was such as to produce (reasonable 
expectancy) self'Coneciousness in the individual subjects, yet 27% of 
the Bclf-assu ranee — self-distrust responses were neither favorable nor un- 
favorable, and these ranked highest of the in-between responses. 

Relationship between Categories and Acquaintanceship Groups 

A study of Table 2 makes possible the following generalizations re- 
garding relationships between categories and acquaintanceship groups, 

1. Psychological responses constitute the greatest proportion of the 
total responses, 30% of the total number. They are also most frequent 
in all acquaintance groups, except the ^‘Don’t know her” group, where 
responses concerning grooming are slightly in the lead. Tliia tends to 
indicate that grooming is most obvious to the stranger, but as the girls 
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Table 2 


Percentage Difitribntion of Respoi^acs (IIC Obaorvcrs) 


Category 

Don't 

Know 

Her 

Know 

Her 

Slightly 

Know 

Her 

Woll 

A 

Friend 

All 

Groups 

Physical 

24.0 

24,2 

27.0 

24,8 

242 

Intelligence 

1.1 

.8 

.6 

,9 

M 

Clothing 

16,8 

14.8 

12.2 

13,3 

16.-1 

Grooming 

ao .3 

27.2 

22.7 

22.0 

20.3 

Paychological 

28.8 

33.0 

37.7 

38.5 

30.2 


Total 100.0 

100.0 

100.1 

100.1 

100.2 


N « 0,S99 

1,558 

393 

220 

0,070 


become better acquainted, responaea of a psycliological nature increase, 
this increase, in this study, being 9 J%. They seem to indicate that 
strangers tend to comment about grooming, while acquaintances tend to 
comment concerning traits, attitudes, and temperament. 

2. Grooming responses take second place and show a decrease as 
acquaintanceship increases, this decrease being 7.7%, namely, from 30.3 
to 22.6%, 

3. The responses of a physical nature take third place in “All Groups’^ 
and in the “Don’t know her” and “Know her slightly” groups, and 
second place in the hat two groups. The better acqiiainted the girls 
were, the more they tended to comment about physical characteristics 
and less about clothing and grooming. Responses of a physical nature 
also remain almost constant for each acquaintance group, namely, 
about 24%. 

4. Clothing^ takes fourth place in all acquaintance groups. The 
clothes the students wore elicited comment only half as frequently as 
grooming or psychological characteristics. Clothing responses remain 
nearly the same for each group, ranging from 12 to 15%. 

Relationships between categories and acquaintanceship groups, as 
influenced by favorableneas, are indicated in Table 3. Certain inferences 
can be drawn from the percentages given. 

1. A large majority of the 9,076 responses indicate favorable impres- 
sions — ^62% favorable to 28% unfavorable. The proportion is five favor- 
able responses to three unfavorable and in-between combined. This 
majority of favorable responses is true for the total responses in nil live 
categories. This finding corroborates Jennings^ statement that “positive 
expression for participating with others was practically twice as great as 
the expression of rejection.”® 

® Helen Hall Jennings, Lead&Bhip aTid laolalton, p, 60, 1043. 
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Table 3 

Per Cent of Favorable and Unfavorable Responaes Cloaaified According to 
Acquointanccsbip Group and Category (116 Obaervera) 


Category 


Don^t 

Know 

Her 

Know 

Her 

Slightly 

Know 

Her 

Well 

A 

Friend 

Total 

Pliyaical 

+ 

07.6 

70.0 

84.0 

91.1 

69.3 


0 

9.9 

8.0 

3.8 

1.8 

9.0 


— 

22.7 

22.0 

12.3 

7.1 

21.7 


Total 

100,1 

100.0 

100.1 

100,0 

100.0 


N = 1,053 

377 

106 

6Q 

2,192 

In belli gcncQ 

+ 

74.4 

60-2 

100,0 

100.0 

74.7 


0 

14.1 

23.1 

00.0 

00.0 

14,7 


- 

11.6 

7.7 

00.0 

00.0 

10.6 


Total 

100.0 

100.0 

100.0 

100.0 

gg.9 


N = 

78 

13 

2 

2 

95 

Clothing 

-h 

G2.3 

60.7 

77.1 

86.7 

64.0 


0 

5.6 

6.2 

00.0 

3.3 

6.2 


— 

32.2 

25.1 

22.9 

10.0 

30.2 


Total 

100,0 

100.0 

100.0 

100.0 

100.0 


N - 1,088 

231 

48 

30 

1,397 

Grooming 

+ 

60.6 

64.6 

74,2 

70.6 

68,7 


0 

7.0 

7.1 

1.1 

2,0 

7.2 


— 

36,0 

28.4 

24.7 

21.6 

34.0 


Total 

100.0 

100.0 

100.0 

100.0 

99.9 

Pay cliQ logical 

+ 

6G.0 

66.3 

68,2 

87.4 

69.7 


0 

13.3 

11.7 

10.1 

6.8 

12.6 


— 

30.7 

22.0 

21.6 

6.9 

27.8 


Total 

100.0 

100.0 

00.9 

100,1 

100.1 


N =■ 1,987 

614 

148 

87 

2,730 

Total 

+ 

60.1 

67.3 

75,1 

85.8 

02.6 


0 

0.6 

8.7 

6,1 

3.5 

9.0 


— 

30,4 

24.1 

19.9 

10.6 

2B.3 


Total 

100.0 

ICfO.l 

100.1 

99.9 

99.9 


N = 0,890 

1,558 

393 

226 

9,076 


2, Responsea of a physical nature show a greater per cent of favorable 
responses (omitting intelligence) than clothing, psychological or groom- 
ing, as shown in the ^'Totals'' column of Table 3, the percentage being 69.3. 

The fact that comments regarding physical features were usually 
favorable became quite noticeable while reading the 19,352 responses. 
It is interesting to note that unattractive features of the face were rarely 
commented on. Most of the 21.7% of unfavorable comments in the 
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physical group concerned poaturc (42.4%), a factor which usually can 
be corrected, 

3. Clothing and grooming show the greatest per cent of unfavorable 
responses (30 and 34 respectively). These features can be changed; 
therefore the girls may have felt they could be critical 

4. The in-between responses show the greatest per cent of reapongea 
in the psychological category and tho next greatest in the physical 
Again, the general tendency of the observer is to refrain from responding, 
or to give an indifferent reaponae, it the feature ia one that cannot be 
easily changed. 

5. An increase in the extent of acquaintanceship ia accompanied by 
an increase in favorable impressiona, as shown in the per cent of total 
responses, where the percentage increase ia from 60.1 for ^^DonT know 
her'' to 67-3 for '*Know her slightly,'' 76.1 for "Know her well," and 65.8 
for “A friend.'’ This increase is true for each of the individual groups, — 
physical, clothing, grooming, and psychological 

B. The per cent of increase in favorable comments with acquaintance- 
ship (that ia, from "Don't know her" to "A friend") was sharpest in the 
psychological category, — 31.4%. As the etudenta became better ac- 
quainted they showed a greater tendency to remark favorably about 
psychological factors. Grooming shows the least gain, 20%. 

What Influence do the Observer's Own Characterialics Have on 
Her Observations? 

Ag noted before, the personality adjustment of each student was 
obtained from results on. the Bell "The Adjustment Inventory" and her 
intelligence score on the Ohio State University Psychological Test, It 
seemed that certain, inferences could be drawn from the observer's chav- 
act eristics, OS revealed by these tests, and her observations. 

1. Correlations between the observers' scores on the separate sections 
of the Bell- Adjustment Inventory and the favorable responses made by 
the observers show coeffleientg less than .089, except in the case of Bell 
(Home) and favorable impressions where r = ,28, a value significant at 
the .01 level This seems to indicate a slight tendency for students with 
satisfactory home life to give favorable responses about their fellow- 
students. 

2. The observer’s personality adjustment (Bell-Total) and the kind 
of responses the observer makes — ^physical, clothing, grooming, or psy- 
chological — seem to be independent of each other. Each of the four 
correlations has a numerical value leas than .13, and these are not sig- 
nificant at the ,01 level 
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What influence does the observer's intelligence have on the kind of 
response she makes? 

1, The observer’s intelligence (Ohio State University Psychological 
Teat) and the favorable responses she makes seem to be independent of 
each other (r = -.10). The more intelligent observer, on the whole, is 
about Q8 favorable in her responses as the less intelligent observer.® 

2, The observer's intelligence and the kind of response she makes — 
physical, clothing, grooming, or paychological — aeem to be independent 
of each other, except in the case of clothing wliere r = .34, being signifi- 
cant at the .01 level. This seems to indicate that there is a tendency for 
students who arc above average in intelligence to make more than an 
average number of comments about clothing. College women on the 
freshman level are clothes-conacioua. It is possible that the more intelli- 
gent girl may be more observant, and alao that she may know more about 
the latest mode, or what is correct in costume, than the less intelligent 
girl 

3, The more intelligent observer tends to give a gi'eater variety of 
responses than the leas intelligent: r = ,32, this being significant at the 
.01 level. This may indicate that the less intelligent student tends to 
make the same type of comment in giving her impressions, limiting her 
statements to a few sub-topics. 

Certain other factors seemed to influence the observer's impressions. 

1. Obaevvera differ Ln their taste in dress, One remarked about a 
subject: ^'She dresses nicely" (-1). Another stated of the same subject: 
‘'Anklets don't match dress" (— ). 

2. Observers differ in Iheir standards of grooming. One remarked: 
‘'Well groomed" (+), while another's comment about the same subject 
was: "Could be more neatly dressed" ( — ), 

3. Observers differ in their interpretation of traits and attitudes. 
One observer remarked: "Looks friendly" (+), while another said of the 
same subject: "Looks like she might be hard to get along with" ( — ). 

4. Observers differ in their conception of "Good looks." One ob- 
server remarked about a subject, "Not attractive” (^), while another 
remarked: "She has simple beauty" (+), while a third described her as 
"Fairly attractive” (0). 


Summary 

This study of impressions of one's classinates shows that the freshman 
girls included in the study were favorable in their evaluations of their 

" Duck found a low correlation between thinking and behavior. Buok, N. M,, and 
Ojemann, R. H., Relation between ability in acicntific thinking and behavior in aitua- 
tione involving choice. J. exper. Ediic.^ 1942, 11, 217. 
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classmates rather than unfavorable or nGulrnl, Tliorc were blircc favor- 
able responses for every two unfavorable and iu-betwceii combined. 
This would indicate that the ‘‘frankness of modern yoiitii'" is of a kindly 
nature rattier tlian the opposite. 

The 9,07G responses made by the 110 observers wore found to fit in 
the five selected categories: (1) physical characteristics; (2) iiitcnigence; 
(3) clothing; (4) grooming; (5) psychological cluiractevistics, hucIi as 
traits, attitudes, and temperaiUGut* They also could be broken down 
into the 49 concrete (actors of varying importance in the iuclgmcnt of 
these freshman girls. However, over 50% of the impressions were cov*- 
ered by 6 sub-topics and 90% by 18 sub-topics (see Table 1), 

Of the five categories, responses of a psychological nature were moat 
frequent, with grooming second, physical characteristics third, clothing 
fourth, and intelligence fifth. Students who were not acquainted tended 
to remark on grooming, but as acquaintance increased they tended to 
comment increasingly on psychological characteristics. Degree of ac- 
quaintancealiip has little effect on the per cent of responses of a physical 
or clothing nature. 

Characteristics of a physical nature, especially the face and features, 
were commented on favorably more frequently than other factors. On 
the whole, the students were very considerate when nothing could be 
done to correct a defect But they were equally critical when grooming 
or clothing was concerned. 

There seemed to be no significant coi relation between a flfcudcnt\s own 
personality adjustment and her inclination to give favorable or unfavor- 
able responses, or to comment about physical, grooming, cloiliing, or 
psychological factors. Where the girls had favorable home conditions, 
however, they tehded to respond favorably. 

Nor was there significant correlation between a sfcv\dent's intelligence 
and her favorable or unfavorable replies or her responses regarding 
pliysical, grooming, clothing, or psychological charocteristica. They 
seem to be independent of each other, except in the case of clothing, 
where there appears to be a alight tendency for the more intelligent girl 
to comment about clothes. 

The responses showed that students vary greatly in their taste in 
dress, their standards of grooming, in their interpretation of traits and 
attitudes, and in their criteria for ^‘good looks.'^ 

Tlie responses of a physical and clothing nature are about constant 
for the four acquaintance groups. But responses regarding grooming 
decrease as acquaintanceship increases, while psychological responses 
increase with acquaintanceship. 

Within the limits and limitations of this study, the results may sug- 
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gest the pattern of responsca nccesaary to get along with other people. 
Although limited in acoj^e^ its findinga may point the way to arena which 
need development. 

Received February D, iO/f/f. 
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The Value of Aptitude Tests for Factory Workers in the 
Aircraft Engine and Propeller Industries * 

John T. Shuman 

Technical htsliivle, TTiWiain^jiori, Pennsylvania 

The general problem of this investigation might bo stated as follows; 
to develop a testing program for a company manufacturing radial and 
opposed types of aircraft engines, and to investigate the feasibility of 
using these same teats for upgrading the supervisory forces of three 
dissimilar companies of the same parent corporation. 

Both factory and supervisory jobs were investigated at Lycoming 
Division— The Aviation Corporation. This industrial plant manufac- 
tures aircraft engines involving all the jobs necessary to the precision 
machining of engine parts. Only the supervisory jobs were investigated 
at a foundry, Spencer Heater Division— The Aviation Corporation, and 
at a propeller plant. The American Propeller Corporation. 

More specifically the investigation was designed to determine whether 
tests at the Lycoming engine plant would: 

а. Assisi in the selection of new employees without previous experi- 
ence in this type of industrial activity. 

б. Assist in the selection of new employees for work in fields as ma- 
chine operation, inspection, engine testing, the more skilled production 
jobs. 

c. Assist in the selection of new employees to be trained as skilled 
workmen, as tool room workers, tool designers. 

d. Assist in the problem of upgrading and promoting employees to 
supervisory positions. 

e. Assist in the better adjustment of employees. 

The investigation was further designed to determine whether these 
seme tests utilized in the Lycoming plant could be used to assist in the 
problem of selection, and promotion of employees to supervisory posi- 
tions in all three of the plants studied. 

* An Ab&tiaet of a disBerbation Bubroitbed in partial fulftHiinenb of tho requiremonia 
for the degree of Doctor of Education at Tho Pcnnsylvotiia Stato College, Fobruory, 
1044. The aubbor msbes to aohnowiedge bhe helpful suggCBbiouB received from Dr. 
B. V. Moore, Dr. C. C. Peters, and Dr. F. H. Koos in connection with various phosts 
of the investigation. A second article dealing with supervisors will follow in the next issue 
of J, appl. Psychol, 


156 



Value of A'ptiiude Tests for Factory Workers 157 

Criteria for Measuring Job Success 

A job rating made by tbe worker's superior was utilized to measure 
success on the Job. 

Each workman was rated good, average or poor on his job. If he 
had been transferred from one job to another, the reason for the transfer 
was ascertained. 

The employee's immediate supervisor was also asked what good and 
poor points the ratee exhibited, The reason for transfer and the com- 
ments were used aa checks on the rating; if they did not parallel the 
rating, the super visor was cheeked to determine the reason for the 
difference. 

The criteria used were the best possible for this particular situation; 
and the work of securing the criteria was carefully executed, Ratings 
were secured by several trained workers who contacted personally super- 
visors familiar with the ratees. No rating was made unless one or more 
supervisors thoroughly familiar with the work of the ratee could be 
found, Because of ''war conditions" inside the plants this was some- 
times difficult and criticaL 

The reliability of the criteria wag found in two eituationa. These 
checks were made by having a trained departmental instructor rate the 
operators, and then securing a rating through the production supeiviBor 
as explained above. The reliability coefficients aeouted were: Produc- 
tion Engine Testers, .91 (N-42); Inspectors, .705 (N-36). 

Procedure 

Test results were secured in two ways. Some groups of experienced 
operators were tested. Each of these operators had six months or more 
experience on a job, and it was assumed that he had proved satisfactory 
on that job or that he would not have been allowed to remain on ib. 
Ratings were secured on these groups in the usual way after testing. 

New applicants for jobs also were tested. Those applicants who were 
successful in securing jobs were followed up after six months or more in 
the plant, and ratings secured on them. 

The following testa were used in the investigation: Otia Quick-Scoring 
Test of Mental Ability, Beta, Eorm A; Revised Minnesota Paper Form 
Board, A A; Bennett Teat of Mechanical Comprelienaiou, Form. AA; 
O'Rourke Test of Mechanical Ability, Jr. Gr. ; and Minnesota Vocational 
Test for Clerical Workers, Number Comparison. 

The use of the O'Rourke teat was abandoned early in the investiga- 
tion because of its length, and because it proved to be almost useless with 
female applicants, many of whom simply didn't try to take it. Further, 
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as more and more peraona were hired from other than industrial occupa- 
tions, the basis for this test seemed not to be suitable - 

The value or effectiveneaa of tJic tests is assessed in terms of simple 
percentage figures indicating the extent to wJiich their use increased the 
effectiveness of the current personnel procedures. That ia, by how much 
will the tests increase the effectiveness of the present hiring job as shown 
by the percentage of good operators hived. 

Although it is believed that the correlation does not give n true picture 
of the results, they are also presented in the form of biserial for those 
technicians who prefer to think in these terms. 

Results are presented in a number of histograms and tables, Sum- 
maries of the tables are given here. 

Table 1 presents a summary of the recommended minimum critical 
scores and the per cent improvement effected in the selection of excellent 
workers. 

Table 1 


Improvement Effected in. Selcobion of Excellent Workers by Selected Minimum 
Critical Scores, Lycoming Division— The Aviation Corporation 



Otis Q.S. Test of 
Mental Ability, 

Beta A 

Minnesota 

Paper Form 

Board, Hov. 

Bonnot b Test of 
Mcoh, Compre- 
hoiiflion, AA 

Minimum 
Job Critical 

Group Score 

% Im- 
provement 
Selection, 
Excellent 
Workers 

Minimum 

Critical 

Score 

%Iin- 

proYoment 

Selection, 

ExcQUetifc 

Workers 

Minimum 

Critical 

Score 

% Im- 
proYomont 
Selection, 
Excellent 
Workers 

Toolmaker 

learners 

(N-64) 

61 

9 

33 

7 

35 

5 

Inspectors 

(M&F) 

(N*4Q) 

51 

27 

37 

29 


12 

Engine 

testers 

(N-46) 

40 

19 

21 


F-IO 

33 

28 

10 

Job Betters 
(N-26) 

34 

17 

30 

30 

36 

47 

PoTemeD 

(N-e&) 

35 

9 

24 

S 

30 

10 

Machine 

operators 

(M&F) 

(N-Bl) 

31 

10 

21 

8 

M-27 

22 

— 





F-IS 

12 
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Table 2 

Averago ImprovemDiit KlTcctctl in Selection of Excellent Workers, All Jobs, 
Ly coming Liviaion* 


Test 

Mean Improvement in 
Selection Excellent 
Workers at Minimum 
Critical Score 

Mean Improvement in 
Selection Excellent 
Workers at Qi 

Bennett Test of Mcclmnical 
Comprelicnaion, A A 

18.2% 

19.0% 

Otis Test of Mental Ability, 
Beta Test, Form A 

18.1% 

ia.2% 

Revised Minnesota Paper 

Form Board, AA 

13.6% 

14.0% 


*Thc means given in the Table are not weighted by the N'a but arc averages of 
percentages by job categories. Tins wna done because the moan of the differont job 
categories and nob of the number tested was desired. 


Table 2 was developed by the simple expedient of aveiaging the 
results secured by each test for all job categories in the Lycoming Plant 
(see Table 1). Table 2 gives the mean per cent of improvement in 
selection effected at the various Minimum Critical Scores and at Qi. 
These means indicate that the Bennett Test was on the whole the most 
effective of the threoj with the Otis Test next and the Revised Minnesota 
Paper Form Board the least efficient. 

Table 3 

Corrolfltions Between Job Ratings and Test Scores, Lycoming Division — 

The Aviation Corporation 


Biserial r 


Job Group 

Otis Q.S. Test of 
Mental Ability, 
Beta A 

Minnesota Paper 
Form Board, 
Revised 

Bennett Teat of 
Mechanical Com- 
prehension, AA* 

Inspectors 

.62 ± .09 

.50 zt .09 

.665 ±.13 

Engine tcstciB 

.67 ±.13 

.16 i .17 

.17 rh.l7 

Machine operators 

.48 ±.08 

.38 d= .08 

,44 ±.08 

Foremen 

.30 ± .07 

.47 ± .07 

,405 ± .07 

Job BOttcra 

.46 ±.14 

.59 zfc .13 

,73 ±.10 

Tool room IcarnerH 

.485 ± .00 

.42 i .09 

.46 ± 09 

Mean blsr^* 

.49 ± .035 

.44 zb .04 

,52 ±.03 


+ All correlations in this column arc for male only. The iiispectora and machine 
operators arc the only two categories iiITcctcd. All other job groups have no female 
workers. 

The method used for averaging was that recommended by Garrett, jSlatiatics in 
psychology and education, Longmana, p. 284. Each r was squared, the squares averaged, 
and tha square root extracted of the average thus obtained. 
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Aveiagvng the r's in Table 3 seenia a justifiable procedure because 
the v's did not difiet greatly in siae and one of the objectives of this 
investigation was to determine to what extent certain tests exercised 
discrimination in a relatively large number of job clnssificntionH. 

Conclusions 

1. The three tests most extensively used selected excellent workers 
in the following order reading from the moat to the least offecLivo; that 
is, the Bennett Teat was the moat aelective, the Otis next, and the 
Minnesota Paper Form Board the least efficient of the three. 

2. Job-auccesa on the purely manual-type job in the Lycoming plant 
shows no relation with the test scores. Discussion of these j obs has been 
omitted from this report. 

3. Job-success on the jobs requiring skill, such as macliining pre- 
cision parts, testing aircraft engines, and inspection waa found to relate 
positively and significantly with the test gcovea, in varying percentngca 
01 degrees. 

4. The large range of aptitudes found in the industrial plant studied 
indicates that tests might best be used for assignment of employees to 
a job category or level rather than to specific jobs. In other words tho 
function of a testing program should be primarily tho better adjustment 
of workers, 

5. The Minnesota Number Checking Teat used in studying Produc- 
tion Engine Testers scema not to have a ivide enough application on other 
types of work to warrant ita use with other groups. 

6. Tinder tight labor conditions tests in general miiat be usable with 
both men and women. A test such aa the Bennett Teat of Mechanical 
Cotnprehenaion, if usable with both men and women with little variation 
in range, would be much more valuable in many cases. 

ileceiiied March 15^ J9^, 



Studies in International Morse Code 
4. A Note on Second-Level Training in Code Reception 

Fred S. Keller 

Columbia Vnivemly 

In the first paper of this series/ there >Yas described a new procedure 
for teaching beginnera to recognize the thirty-six principal signals of 
International Morse Code. Essentially, this procedure involves the 
presentation of an auditory signal to the student and a subsequent 
identification of the signal by the instructor, with a short pause between 
signal and identification, to permit the student to write down the appro- 
priate character (letter or digit). The signals are transmitted and 
identified individually; one hundred signals, arranged in random order, 
constitute a practice "run,” after which the student is given a brief 
rest-period in which to sum his errors and enter the total in a "box-score” 
record. 

Although no sharp line may be drawn between this early training in 
the accurate recognition of individual signals and the later practice in 
elow-apeed reception of a eeriea of signals, it is convenient to distinguish 
between the stage in which the fundamental stimulua-responae relation- 
ships are established and that at which speed of response becomes all- 
important. The former may be termed "first-level,” and the latter, 
"second-level," training. 

The present report is concerned with two variations of a method of 
second-level training which have proved to be effective in bringing stu- 
dents of college age from a code speed of five words* per minute (5 w.p.m.) 
to speeds as high as 20 w.p.m. in less than fifty-five hours of instruction. 
In either form, this method ditfem from those commonly used in training 
centers, in that (1) it provides the student with knowledge of his progress 
at practically every moment throughout the entire period of instruction; 
(2) it encourages close attention to all signals transmitted within, any 
practice se88i()n ; and (3) it provides regular rest pauses at increasingly 
frequent intervals as the student advances in speed. 

‘ Kellot, F. S. Sludica iu Inl.crnfttional Motac Code. 1. A. now motliod of teaching 
Codo reception. J. appL Paychal,, 1043, 27, 407-415. 

’ A "word" ia here treated na ony Qvc-charactcr group of lettors and digits rondoraly 
wnnged— e.g., AI124P, B8GIIX, etc. 
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Variation 1. The first VEtrlation of this method requires as many 
opBTatoTS or automatic sending^nachiues as there are different speeds at 
which students itvibhin a group arc qualified to work* In a class of 
twenty or thirty college students, with available code-speeds of 5, 7, 10, 
12, 16, and 20 w.p.m., more than three instructors are fielclom needed 
in order to meet the problem of individual difference in progress; Init n 
larger or less homogeneous group of students might require the services 
of four, or possibly five, operators transmitting at as many different 
speeds. 

Follo^ving the satisfactory completion of first-level training, the stu- 
dent is introduced to a rate of tranamission. Siguala continue' 

to be sent in runs of one hundred each, with all characters represented 
with equal frequency, in haphazard arvangement. The signals are not, 
however, individually identified by the instructor as in first-level training. 
Instead, at the end of each run, he ^^callg back'* the phonetic equivalents 
(Able, Baker, Charlie, Dog, etc.) of the signals just transmitted, and the 
student checks, or corrects, his erroneoua or omitted characters. The 
same practice sheets are used, and error totals are recorded in the same 
boX'Seore form, as in first-level training (1, see Figs. 1 and 2), 

At a 6-w.p.m. rate of transmission, a run of signals requires four 
minutes, and four or five minutes may be consumed in checking errors, 
as the characters are called back, and in recording scores. It is usually 
possible to transmit five runs within a fitty-minute practice session. At 
higher rates of speed, of course, a larger number of runs may be given, 
although the between-run interval remains fairly consi-ant. 

Students are advanced from one speed to another as soon as they 
have reached some arbitrarily chosen degree of proficiency. The results 
reported in this paper are based upon a mastery criterion of three suc- 
cessive rung in no one of which the student made more than five errors 
or omissions. This was also the criterion of first-level proficiency, as 
well as that in the procedure next to be described. 

Variation 2. This variation of the calling-back method may be 
employed when a single instructor, working with a single sound source, 
is required to give instruction to a group of students. It is usually 
introduced while fixatJevel training ia still going on, and it differs from 
Variation 1 only in that it calls for the tranamigsion of signals at different 
speeds to the same students during the same class hour. In order to 
accomplish this, the instructor may proceed, in stepwise fashion, from 
the slowest to the highest speeds at which his students are able to work, 
giving most practice at the speed suitable to the greatest number of 
etudents. Thus, when a few students have qualified at the first level of 
training, a single run of 5 w.p.m, may be introduced at the end of the 
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class hour; wlicn more studenta reach this level, more 6-w.p.m. nms may 
be added; when the 5-w.p.m. speed ia mastered by some students, a 
7.vf,p.Tft. run m-y he introduced; md rq on throughont the tiaining 
period. As soon ns all of the students, or all but one or two, have quali- 
fied at the lowest speed in use, then, of course, that speed may bo omitted 
entirely. 

Table 1 


rrogiesi of Two Groups of CJoIIckc filudcnls in Receiving Morso Codo under Two 
ViiriiilioiiH of Sccoiid-Lcvel Inatniction 


Speed 

(w.p-ni.) 

Group I 
(Variulion 1) 

Group II 
(Variation 3) 

Hoot#’* 

(SO-iniimtc) 

Number of 
SLudenta 

Hours* 

( 56 -miuute) 

Number of 
Students 

6 

17.8, 

40 

18 

50 

7 

23.1 

38 

25.4 

66 

10 

35.0 

33 

37.6 

56 

12 

41.7 

22 

61.5 

24 


* Tlio values in the “Houra" columns ore cumubllvo. Tho dccrcasiuB number of 
students at higher code speed# is due in part to withdrawn! of students from ooUogo, 


Table 1 presents somo illustrative data on the total training time 
required for atudents to (pialify at four aucoeasive levels of code speed 
under the two conditrona described above. Code classes were held one 
“hour” daily (50 miniitea), five daya a week, and the practice periods 
were devoted wholly to receiving. All students were inexperienced in 
code at the beginning of training and all but three or four were able to 
ma,ater the lO-w.p.m. speed before the course was ended. A few men 
reached the 15-w.p,m. level and one reached 20 w.p.m., in less than 
fifty-five hours, hut the number is too small to warrant table entries. 
Three men only failed to qualify at 5 w.p.m. The difference between 
the means for the two group.# ia in part due to the fact that, under the 
second variation of procedure, the slower men were retarded because of 
the infrequency of runs at the speed which they were seeking to master. 

Received Ii'ebruery 83, lOZ/f. 


Job Specifications in Applied Psychology 

Note; The editor will be glad to recoivo job dcacriptiona and apccifioationa 
in the hdda of applied psychology. These will be published from time to 
time to provide information (or sludonte, applied psychologists, employ era, and 
employment agencies. 

Personnel Technician (Tests and Measurementa) * 

Introduction. This aeries includes all classes of positions, the duties 
of which are to construct and administer or superviao the conatruction 
and administration of psychological measuTce, including aptitude teats, 
intelligence testa, achievement and trade teats, queationnnirea, rating 
scales, etc., to be used as aids in the selection, placement, tvaiiiing, and 
promotion of civilian and military personnel. 

It is believed that the following statements of standards for the 
positions of personnel tcchniciang (testa and moasuremeivta) cover the 
majority of operating positions in the War Department field service. 
Positiona of higher grade are found on the staff level, These staff posi- 
tions involve the formulation of policy and procedures to be used in the 
eonstraction and administration of psychological measurea througliout 
the War Department. 

Two general types of positiona operating in the War Department field 
installations are representative of classes properly allocable to this series; 
1, Positions involving the construction, validation, and standardization 
of psychological measurea. 2. Positions involving the administration, 
scoring of psychological measures, and the interpretation and application 
of the results of these measures to the placement, training, and 'promotion 
of civilian and military peraonneh 

positions in the Personnel Technician Series may be allocated from 
grades P-1 through P-5 depending upon the following factors which are 
interrelated and should not be considered independently: 

1. For positions involving the construction of paychological tncaaurea. 

a. Degree of instruction and guidance given incumbent by superiors. 

b. Presence and degree of responsihility for technical accuracy of 
completed projects, 

c. Presence and degree of responsibility for planning and direction of 
program and projects. 

* These job apeclfioatlonB wore prepared by Ihe Salary and Wage Administration 
Branch, Civilian PetBonaol Division, Office, SoctsUty oi War, for use in cla.9sifying civil' 
ian posltioaa in War Department field eBtabliehmenta. 
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d. Reaponsibiliby for training otlier personnel techniciane of lower 
grade. 

c. Amount of psycliologicnl knowledge required in the performance of 
asaignmenfca. 

2, For positiona involving the administration of psychological meaa- 
nrea. 

a. Degree oC iuKtrucUau and gukUuiee eauc^viviug pvoeedwres 

given iuciunbeut by supeviors. 

b. l^rcscncc und degree of icsponsibiUty for xccommendationg con- 
cerning placement, tniining, and promotion of personnel tested. 

c. Degree of interpretation and application of test rcsalts. 

d. Presence and degree of individual accountability for accuracy of 
results. 

e. Presence and degree of responsibility for planning and direction of 
program. 

The following definitions may aid in the complete understanding of 
these standards; 

Aptitude tesL One which predicts degicc of success or failure in some 
field or activity. 

Achievement test. One which cletermine.s level of skill or range of 
information which au individual has ticquircch 

Objcclm iesL Slun‘t item tests in which there is little disagreement 
among tliose who Itnow tlie subject nniller concerning correctness of 
answer. 

Gejicral ability, fhineral intelligoiicc or classiricaiioii test — group 
or bfittory of tcsls .siieli u.s vocabulary, general iiiforination, arithmetical 
reasoning, and HjmLial relations which measure the grade or level of the 
individual's mental ability. 

Validity, The degree to which a test measures the traits or trait it 
purports to moasure. 

Zieftabiii^y. The degree to which a test produces the same results or 
score upon iGtest. 

Worn. The di.slrilnition of scores obtained from a represeutative 
sample of the population for which the test is designed. 

Process of standardization. Involve.s tlic detenu inn tioii of the validity 
and reliability and tlic (‘staldisljiiiont of norms for p.syehological tests. 

iikill. A (l(5velnp(;(l (U' acquired aljility to perform a task, group of 
tasks, trade, or er/ift. 

Test ballmj. A coJiihination of carefully scleetcd tes(,s designed to 
determine ccrluiii upLitudes, abiUliOvS, achieveiiiciiLs, or skills, 

Per/oniiaucc /rxSi. A type of mental test iu which the role of language 
ia greatly reduced, the test material couaistiiig of eoucrctc objects or 
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pictures, and tlie responses consisting of manipulation or QsaemWing of 
these objects, e.g., meclrnmcal assembly test, work sample. 

Correlalion technique. A statistical method applied in obtaining the 
degree of relationship existing between two sets of measurea, such as test 
scores. There are several types of correlation techniques. 1^ or example, 
biserial, tetraclioricj multiple, partial, etc. Each tecliniquc utilizes a 
different statistical formula. The determination of the apcciSe technique 
to be used depends on the nature of the problem, the data available, and 
the degree of accuracy and form of results desired. 

Central tendency. A measure or score representing tlie middle of a 
group, e.g., mean, median, or mode. 

Bispernon. The extent to which a group of measures such as test 
scores vary from central tendency. 

Personnel Technician, P-1 

The area of responsibility of grade P-1 personnel technicians is limited 
by specific instructions and continuous technical superviaioa by pro- 
fessional personnel of higher grades. Incumbents at tliig level usually 
serve as trainees in order to become familiar with the techniques and 
tools necessary to perform more responsiblo work in the field of psycho- 
logical test construction and administration. All of their work is re- 
viewed for technical adequacy, accuracy, and contormancG to standard- 
ized procedure. 

Personnel technicians at this grade collect background material con- 
cerning the subject, trade, or skill for which the test, rating scale, ques- 
tionnaire, etc., ia to be constructed. Following outlined sourcea of 
material, they study technical manuals and other soiircoa of occupational 
information, and interview foremen, supervisors, and akilled workers in 
the field analyzing their jobs in order to determine the essential skills 
and steps involved in the adequate performance of the work. They 
perform assigned statistical analyses of data from test studies conducted 
in the field and on tests constructed by other members of that unit as 
part of the test standardization process. Following defined procedures, 
they apply simpler statistical techniques such as correlation formulae to 
teat data in order to determine the reliability and validity of tests. 

Grade P-1 personnel technicians, following specific instructions con- 
cerning test specifications, subject matter to be covered, types of items, 
weights, time element, etc., construct objective test items for a variety 
of subjects, trades, or skills. They may edit test items for conformance 
to the accepted style (choice and arrangement of words) written by other 
personnel technicians at this grade, following detailed instructions and 
aamplea of it etna. 
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Personnel technicians in this class j applying their professional educa- 
tional background and following specific instructions, analyze^ evaluate, 
and abstract pertinent material relating to test construction and testing 
procedures from scientific and professional journals. 

Grade P-1 personnel technicians functioning in a testing unit ndmin- 
iater and score a variety of individual and group testa of aptitudes and 
abilities following Bpecific instructions concerning choice of testa and 
metliods of administration and scoring. While working at this levels they 
receive instruction and guidance from personnel technicians concerning 
interpretation of test results and application of these results to the place- 
ment and training of personnel. 

Personnel Technician, P-2 

Grade P-2 personnel technicians work under supervision of personnel 
technieiang of higher grade, receiving instructions concBming the general 
procedures and techniques to be followed in completing an assigned 
project or portion of a project, but working out details on own initiative, 
and selecting a specific technique from several standardized procedures. 
Grade P-2 personnel technicians, although advanced beyond the pre- 
liminary training period, are given training and instruction on the more 
difficult phases of their assignments. Their work is reviewed for tech- 
nical adequacy, acouraoy, and conformance to standardized procedures. 

Personnel techiiiciana at this level select sources to be used and collect 
and analyze tccbnical background matcml conceTmng the subject, trade, 
or skill for which the test, rating scale, questionnaire, etc., is to be con- 
structed. They conduct interviews with foremen, supervisors, and skilled 
workers in the field, analyzing their jobs in order bo determine the essen- 
tial skills and steps involved in the adequate performance of the work. 
Following established criteria, tliey select significant factors from the 
information gathered and they convert job information into valid objec- 
tive teat items. 

Grade P-2 personnel technicians, following instructions concerning 
test specifications, general format of test, .subject matter to be covered, 
types and number of items, construct objective test items for a variety 
of subjects, trades, or skills. They may edit test items written by other 
personnel technicians at this grade for conformance to tlie accepted stylo 
(clioice and arrangement of words) . 

Personnel technicians at this grade write manuals of directions for 
examiners and instniction.s for examinees following format and outline 
used in previous test manuals. 

Personnel technicians at this level perform statistical analyses of data 
from test studies conducted in the field and on tests constructed by other 
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menibBTS of the unit in order to sttitidfl-rdize the testa, Specifictilly, they 
determine which formulae to apply to an oasigned problem after general 
plan for statistical study has been outlined by personnel technicians of 
higher grade. 

Grade P-2 personnel technicians functioning in a testing unit ndmin- 
iater^ score, and interprot a variety of individual and group teats of 
aptitudes and abilities, i.e., achievement and general iutGlligence. At 
this level personnel technicians select the appropriate teats to l)o admin- 
istered to personnel being considered for placement, training, transfer, 
or promotion iu order to determine present level of skilly aptitude, suita- 
bility for employment, and need for training. The tests are selected on 
the basis of information obtained by the placement interviewer and on 
the knowledge whioli the incumbent Iiaa of the uses of specific approved 
tests in relation to success in the various occu])ations. Personnel tech- 
niciana at this grade make preliminary recommeudatioiis to the peraonnel 
technician in charge of a testing unit concerning the accepbability, place- 
ment, and training of the individuals tested, after interpreting the teat 
results. 


Personnel Technician, P-3 

Grade P-3 personnel technicians receive general instructions concern- 
ing objectives of projects but work out detadfl of assignments on own 
initiative, Their work is reviewed for conformance to technical pro- 
cedures and established objectives, Personnel tcchuiciana at this level 
review and edit test items prepared by lower grade teclmiciana. This 
review ia made in order to determine Avhether or not the items of the test 
conform to established principles and patterns of test construction, are 
OTitten in clear English, are free of objectionable content, and of a euffl- 
oient level of difficulty for the group to be tested, but not too diffioult to 
be of value in differentiating the group. 

Grade P-3 personnel technicians following an established plan and 
purpose for a test or a battery of testa construct objective testa covering 
a variety of subjects, trades, or skills, and write manuals of directions for 
examiners and instructions for examinees. 

Personnel technici^ins at this grade review job analyses and trade 
test items prepared by personnel technicians of lower grade in order to 
determine whether or not the Bignihcant factors concerning the job have 
been covered by the test items. In performing this function they draw 
upon their knowledge of jobs and trade tests previously constructed and 
validated. 

Grade P-3 personnel technicians make field trips to posts, campa, and 
stations in conjunction with personnel technicians of higher grade for the 



J oh Specifications in Applied Psychology 


160 


purpose of administering individual testa of mechanical and other apti- 
tudes, and obtaining data for the purpose of validating tests by com- 
paring teat Bcores with efficiency ratinga and other personnel data, 

Personnel teclimciana at this level are reapotisible for statistical analy- 
fliB of teat (lata. This function involves selecting specific statistical tech- 
niques that pertain to the prol)lem from acjveral accepted methods. 

Peraoniicl technicians at this gi’ade assemble and organize information 
for a project report indicating proccdiirea used in gathering facts and 
preparing lists of data obtained, analysis of statistical results, validation 
and standardization techniques and norms established, or conclusions 
reached from the study. 

Grade P-3 personnel technicians may function as assistant chiefs of 
placement testing units in installations having a large variety of complex 
jobs. In this capacity they determine work assignments for personnel 
technicians in the unit on the basis of knowledge of individual teehni- 
oian's experience and qualifications. They discuss these assignments with 
peraonnel technicians of lower grade and make decisions concerning teats 
to be administered and recommendations to bo made in instances where 
the subordinate personnel technicians cannot make the determination. 

Grade P-3 peraonnel techiiiciane may also function as chiefs of place- 
ment testing units in installations having a smaller variety of routine and 
semiroutine jobg. They are rcsponaible for the development and admin- 
istration of a testing program for improving the placement and training 
of employees in order to achieve the maximum utilization ot manpower 
skills available to the installation. In this capacity they gxlide and direct 
a group of personnel technicians of lower grade engaged in administering, 
scoring, and interpreting th(i results of aptitude, performance, trade 
information, and general intoUigeuGe teats. Personnel techniciana at this 
grade make recommendations to the placement and training branches of 
the installation's personnel office concerning the acceptability, placement, 
and training of the individuals tested, on the basis of the interpretation 
of teat results and analysis of abilities, skills, and aptitudes of the 
individuals. 


Personnel TecJiiiician, P-4 

Grade P-4 personnel tcchnicinna function independently with regard 
to technical proced\ires, but wcjtk in conformance >Yith established policies 
concerning objectives to 1)C uccomplished. 

Persomicl technicians at tiiis level arc assigned Rpccial studies re- 
quiring a broad background of psychological measurements and test 
construction techniques, i.e., evaluating testa and rating scales already 
in use by comparing results of different tests. They study groups used 
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in original validation of testa and rating scales iu order to determine 
what other groups can be tested by these measures. On the l)asis of 
these studies they submit recommendations to personnel technicians of 
higher grade for improvements in specifie tc.'sts iind test construction 
techniques. 

Personnel techniciana at this grade liavc the responsibility for tlie 
planning and completion of projects involving the conHlriiction of teats 
and test batteries^ questionnaires, rating scales, cte., whieli measure 
general ability, aptitude, or achievement to classify individuals on the 
job, classify them fox speoialixed tminiug, ov classify them wLthiu triuiung 
groups, or evaluate the effectiveness of the training piogram. Tlmy arc 
responsible for project reports wliich include procedures used in gathering 
facta and preparing tests, data obtained, analysis of statistical results, 
validation and standardization techniques and norms cstal>lishc(l, or eon- 
elusions reached from the study. 

The details of the test construction function iucUide performance or 
the supervision of the following: 

a. Analysis of the job, field, ability, or skill for which the test ia to be 
constructed. 

h, Establishment of test specifications including the determination of 
the type of test to be constructed, the subject matter to bo covered, tlie 
number of items, weights, time element, gIg. 

c. Writing of original test items. 

d. Organization of the items into testa, 

e. Determination of the format of the test. 

/. Organization of the tests into batteries, 

g. Selection of standardization groups and design of test tryouts. 

h. Planning and extension of statistical analyses for determining 
validity and leliabiUty of the tests, test batteries, etc. 

i. Planning and execution of follow-up studies on the tests constructed. 

Personnel technicians at this level accompany higher grade personnel 
technicians on visits to Army installations after requests have been re- 
ceived from auch installations for the establishment of personnel pro- 
cedures requiring the use and application of psychological mcusvires. In 
conjunction with higher grade personnel technicians they analyze the 
test needs in terms of the types of jobs found at the installation and the 
training and skills of the personnel of the installation. The testa may 
be used as aids in selection, placement, or promotion of porsounol and the 
evaluation of the training programs. In making this aualyaiB, the (unc- 
tions and work flow of the installation are studied, personnel are inter- 
viewed, and administrative officials are consulted. After rccommenda- 
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tions concerning testing programs have been approved by the senior 
member of the team, they instruct installation personnel in uses 0 / tests, 
mcthodfl of administration, scoring, and interpretation. They construct 
new testa when existing ones do not fit the problem at hand or adapt or 
extend norms of existing measuring devices to cover the inatallation 
poi’fionncl. 

Grade VA personnel technicians advise personnel technicians of lower 
grades concerning Btatistical procedures to be applied to particular, un- 
precedented, or nniisual probioms. They plan statistical techniques and 
steps to be used in the determination of the validity and reliability of 
tests. The steps include intorcorrelationa of a number of variables, 
measures of central tendency, measures of dispersion, selection of tlie 
minimum number of independent variables which will give maximum 
production of the dependent variable, item analysis by biserial or tetra- 
choric correlations and application of measures which indicate whether 
or not differences obtained are significant. When necessary, new statis- 
tical procedurog are devised to meet special problems. 

Grade P-4 personnel technicians function as chiefs of placement test- 
ing units in installations having a large variety of complex jobs. They 
are responsible for the development and direction of a placement testing 
program in order to achieve the maximum utilization of manpower skills 
available to the inatallation. In this capacity they guide and direct a 
group of personnel technicianB of lower grade engaged in admimateriug, 
scoring, and interpreting the results of aptitude, performance, trade 
information, general intelligence teats, questionnaires, and rating scales. 

Personnel technicians at this grade make recommendations to the 
placement and training branches of the installation's personnel office 
concerning the acceptability, placement, and training of the individuals 
tested on the basis of the interpretation of test results and analysis of the 
abilities, skills, and aptitudes of the individuaLs. 

Personnel Technician, P-5 

Grade P-5 personnel technicians act with independence in planning 
projects and in the development of methods and procedures for the 
conduct of these projects. They receive guidance concerning adminis- 
trative and technical policies and broad objectives of the program. Their 
work is reviewed for conformance to these policies and objectivea. 

Personnel technicians at this level may exercise administrative super- 
vision and technical direction over subordinate professional employees, 
making final decisions with respect to the most difficult and unusual 
technical procedural problems which arise. 

Personnel technicians at this grade visit War Department inatalla- 
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tiona after requeata have been received from such inatallationa for the 
eafcabliahment of peraonnel procedures requiring the use and application 
of testa in order to increase the effectiveness of induction, placement, 
promotion, and training of civilian employees in clerical, mechanical, 
subpxof essional, professional, and supcrviaory positions. In this capacity 
they analyze and evaluate the total personnel program in relation to the 
specific problem in order to determine whether or not the application of 
teats will alleviate the problem. When such study reveala that a testing 
program ia called for, they select the appropriate previously constructed 
teats, or conalruct new measuring devices to meet the problem. The 
performance of this function involves the following; 

а. Analysis of jobs, flow of work, functional organizations, and train- 
ing curricula and standards. 

б, Evaluation of qualifications and performance of present incum- 
bentfl. 

c. Conferences and interviews with employees, supervisory and ad- 
ministrative officiala, and with the members of the staff of the installation* 
civilian personnel dfiice. 

d- Planning and developing of new teat forms and procedures. 

e. Preparation of manuals of direction for administration and scoring 
of teata and interpretations of results. 

/, Determination of adequate criteria for teat validation and devising 
procedures for measuring individual job productivity, both qualitatively 
and quantitatively. 

g. Experimental tryouts of preliminary test forms, statistical analysis 
of data obtained, revisions for final test battery, and establishment of 
norms for group. 

h. Training of installation staff in method of administration and 
scoring of tests and interpretation of results. 

i. Conducting of follow-up studies of testing programs instituted in 
order to recommend revisions in etandarda or in measuring inetrumenta. 

On these visits to field installations, personnel technicians at this level 
advise and assist management on other phases of personnel administra- 
tion such as training, placement, and employee relations, applying their 
psychological knowledge and experience to the specific personnel prob- 
lems of the installation. 

Grade P-6 personnel technicians may plan, organize, and direct the 
work of a staff of professional employees of lower grades engaged in the 
construction and statistical validation of a variety of testa and test 
batteries to be used in the selection, placement, training, and promotion 
of employees. 
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McMurry, Robert N. Handling personalily adjuslment in industry. 

New York: Hni'per and Brothers, 1044, pp, xi+297. $2.50. 

Tlie author states that this book i.s written to give busine-ss executives 
insight into the sources and solutions of problems in personnel adminis- 
tration and industrial relations. Although this ambitious goal is not 
fully attained, the book will give a fresh point of view to any business 
leader who is progressive enough to read and consider its contents. 
Perhaps the book’s greatest contribution, however, will be to give aca- 
demic industrial psychologists greater insight into actual industrial 
conditions, 

The material on labor relations is the outstanding section of the book. 
Several original and provocative ideas regarding labor-management rela- 
tionships are presented. The author contrasts the ineffective means of 
solving labor problems with some techniques that have been effective in 
determining the true causes of strife; the exit interview, grievance com- 
mittee, employee opinion poll, and the home interview. 

For the most part, clinical psychology, psychiatry and psychoanalysis 
have neglected the industrial field. Industry, in turn, has not recognized 
the importance of the personality and emotional factors that affect it. 
The material in this book will help to remedy this situation. Many 
books on industrial psychology emphasize the raeasurement of aptitudes 
and intellectual factors. This book, on the contrary, emphasizes emo- 
tional and motivational factors necessary for success on the job. 

Much emphasis is placed on the diagnosis of personality disorders but 
very little attention is given to treatment techniques. No mention is 
made of non-directive therapy which is being used with good results in 
several industrial situotions. The author points out that many business 
executives have personality problems themselves, but the suggestion is 
never made that these disorders might yield to treatment. 

Much of the material in the sections on selection and ti'aining is 
valuable although not related to the topic of personality problems in 
industry. The chapter on *'The Home Interview” is presented entirely 
as a selection procedure, altlrough it would have been more relevant if 
centered around the theme of personality problems. 

The last thirty-three pages of the book constitute a manual to train em- 
ployment interviewers in the theory of personality. The psychological 
principles set forth are questionable in places, as on page 259 where we read : 
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emotions, on the other hand, do not need to mature. Tliey func- 
tion perfectly at birth. The day-old infant experiences rage and fear as 
intensely as does the adult. In short, emotional reactions do not have 
to be learned. 

Business and academic people interested in human relationships in 
industry will derive considerable help from this book. 

Charles C. Gibbons 

Owms-IlUmi^ Glass Company 
Toledo, Ohio 

Gallup, George. A guide to public opinion polls, Princeton: Princeton 

University Press, 1944, pp. xviii-|-104. $L50. 

Applied psychologists will welcome this book because it contains just 
the type of information to which skeptics or the uninformed may be 
referred when they desire to learn something about this relatively new 
technique. It deals with twelve general topics such aa the function of 
public opinion polls in a democracy, the cross section, formulating ques- 
tions, size of the sample, and polling accuracy. 

The plan of the book is novel and effective. From the first page to 
the bat, it gives a series of questions together with brief answers. The 
total number of questions is 80 covering almost every conceivable aspect 
of polling. The answers, though brief, are straight-forward, factual, and 
convincing. 

In dealing with the question of accuracy in the prediction of elections, 
Gallup makes out a good case for the steady reduction of error from the 
notorious 19 per cent error of the Literary Digest in 1936 to the one or two 
or three per cent errors in the prediction of elections in later years. In 
the opinion of the reviewer, however, this problem ia not faced with 
complete candor. The constant errors in the Literary Digest fiasco are 
described at some length but the presence of such constant errors in the 
Gallup 1940 presidential election poll ia not mentioned. The reviewer 
refers to the fact that the 1940 Gallup poll underestimated the Roosevelt 
vote in state after state. Surprisingly enough, the Gallup poll was unable 
to overcome this type of error in 1944 when it overeatimated RooaevelVs 
vote in ten states and underestimated it in 38, But this specific defect 
should not blind one to the general accuracy and the widespread utility 
of the Gallup poll and of other equally reliable polls. They arc important 
instruments in ascertaining public opinion not only with respect to social 
and political issues, but also in market research, industrial relations, 
education, and all other fields where opinions, beliefs, and attitudes must 
be taken into consideration in dealing with human beings. 

Donald G. Paterson 


The University of Minnesota 
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Dvorinc, Israel. Color perception tcslinff charts (Vol, 1); Color perception 
training charts (Kol. 2). Haltimorc: Published by the author, 1944, 
S25.00. 

These charts arc of the pscudo-isochrorautic type. There are 60 
perception and 70 training plates. Te.sLs for naming colors and for 
training in color naming are included. The colors employed are based 
on the Bubtiftctive color theory, The author erroneously lists the three 
primary colons as red, yellow and blue in.stcad of red, green and blue. 
The perception test i.s not limited to investigation of red-green and blue- 
yellow dcficiencie.s but yields information on perceiving both primary and 
secondary colors, The author considers that some individuals who are 
listed as color blind are only confused by certain color combinations, 
These, although classified as color blind, readily improve when given 
color perception training. It is claimed that these charts will avoid 
uncertainty and error in measurement of color perception. The only 
classifications attempted from responses are: normal in naming and per- 
ceiving colors, correct naming with defective perception, incorrect naming 
and normal perception, incorrect naming and defective perception. 
There is no attempt to designate a person as rcd-greeii color blind, etc. 

The training charts "educate” or coach people to name colors and to 
pass pseudo-isochroinatic color-blind tests such as for the Navy or the 
Air Corps. It would seem that the widespread nse of these training tests 
would tend to nullify the usefulness of all pseudo-isochromatic tests of color 
vision. Miles A. Tinker 


Vnivemlj} of Minnuola 



New Books, Monographs, and Pamphlets 

Crim and the human mind. David Abrahainsen. New Y orlc : Columbia 
University Press, 1044. Pp. xiv + 244. $3.00, 

Diiorine Color Perception Training Charts. Israel Dvorinc, O.D., 2328 
Eutaw Place, Baltimore 17, Maryland. 2 voUimca. 130 color 
charts. $25,00. 

Ahsenledsm: managemenl’s probleyn, John B. Fox and Jerome F, Scott. 
Boston; Division of Research, Harvard Business School, 1943. 81.00. 

Conserving marriage and the family. Ernest R. Groves. New York: 
The Macmillan Company, 1944. Pp. 138. $1.75, 

From gods to dictators. Pryns Hopkins. Girard, Kansas: llnldeman- 
JuliuB Publications, 1044. Pp, 168. Paper 11.00. Cloth |1,66. 

Experiments on the ejects of music on factory production, Willard A, 
Kerr, Applied Psychology Monograph. Stanford University; Stam 
ford University Press, 1944. $1.00, 

Psyc/iotlieropj/ in medical praclicc. Maurice Levine. Chicago; Mac- 
millan Company. Pp. xiv -p 320. $3.50. 

Teamwork and labor turnover m ffie aircraft -industry cf iSouf/ierii California, 
Elton Mayo, George F. Lombard and associatc.s. Boston: Division 
of Research, Harvard Business School, 1944. Pp. 30, 24 charts, 
8 tables, $1.00. (Business Research Studies No. 32.) 

Leaimny by exposure to wrong forms in grammar and spelling. John R. 
Mointoah, New York; Bureau of Publications, Tenchors College, 
Columbia University. Pp. 61. $1.75. 

Emotional factors in learning. Lois B, Murphy and Henry Ladd. Now 
York; Columbia University Press, 1944. Pp. x -|- 410, $3.50, 

Women and men, Amran Scheinfeld. New York; Harcourt, Brace & 
Company, 1944. Pp. 453. $3.50. 

Psychodrama in the schools, Nahum E. Shoobs. New York 17; Beacon 
House, 1944. Psychodrama Monographs, No. 10. Pp, 19. $1.50. 

Glossary of technical terms. Calvin P. Stone, Stanford University: 
Stanford University Press, 1944. Pp. 15. $.25. 

A factorial study of perception. L. L. Thuvstone. Chicago; University 
of Chicago Press, 1944. Pp, 148. $2.50, 

The place of reading in, the elementary sclioot program. Board of Educa- 
tion of the aty of New York. Educational Research Bulletin No. 7. 
Pp. 43. 
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Studies in Job Evaluation : II. The Adequacy of Abbreviated 
Point Ratings for Hourly-Paid Jobs in Three 
Industrial Plants 


C. H, Lawshet Jr. 

Divmm of Kdiication and Applied Psychology, Purdue University 


The growing importance of job evaluation aa a more objective ap- 
proacli to the Htnljilisiiition of indmlrial wage Btructuiea haa manifested 
itself in the inorca.sing degree ' to which paychologiats are concerning 
thcraselvea with the varioua rating mctlioda now in use. To examine by 
psychological mtslhodology some of these job rating techniques has been 
the intent of the authors of this scries of papers, the firat “ of which 
reported the identification of factors or clusters of iteins which appear to 
be functioning in one of the most widely used job rating systems.* The 
purpo.Bc of the investigation reirortcd in the present paper was to deter- 
mine tho extent to which abbreviations of this system yield the same or 
comparable rcsulls and to examine nny differences in terms of practical 
significance. 


Procedure and ReauUa 

Method. Job rating data were collected from three plants which use 
the NEMA system or a slight modification of it. Eor each plant, mter- 
correlationa between nil cloven factors and total points were computed 
and a correlation matrix was prepared.^ 


‘IIcrbcrL Mooro, I’roliloma and mellioda in job cvnluntion. J. conaull. Psychol, 

a IU.!!vh1ic. Jr., ni 3 <l G. A. SuUcr. Sludicfl in job evaluation. 1. Factor imolyscs 
of point rntini^h for lioorly-pnid jnhs in llirce industrial plnnta. - app . syc o ., 


26 180 lOH 

'sjob rating: Dcfruiliorr of the factors used in rotm jobs-hourly rat^ 
ChionKo: Iridimtriiil IlclationB Uepnrtinont, Nntionul Electrical Mnnufactur 


tion, 1038, Pp. 22. 

* These mftlriccw together 
data are preaented in tho first 


with descriptions of the three plnnta and other pertinent 
of this flcrica of papers, C. H, Lawahe, Jr., and G. A. Sftttcr, 


Op. cit. 
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The Wherry-Doolittle shrinkage selection method ns reported by 
Stead Shartle; el al ^ was applied and tJio first three items were identified 
in each plant. The multiple K's nve presented in Tabic L 

Table 1 


Correlation Coefficients hcfcweea llabingfl on Selected Items and 'VnM Point Uatings 


Selected Rating Scule Items 

A 

riiint 

H 

a 

Experience (or Lfcnrning time) 

M 

,93 

M 

Experience (or Learning time) plus llaznrda 

,07 

— 

.01 

Experience plus Initiative 

— 

.05 

— 

Experience (or Learning time) plus Hnznrda 

p\uB Edn cation 


—■ 


Experience plus Hazards plus Initiative 

Experience plus Initiative plus Responsibility 



.93 

for the Safety of Otlvet^ 


.06 

— 


Items Identified. Aa ia shown in Tablo the ^'experience or learning 
time!' item is the single variable which correlates higliest with "total 
points" in each of the three plants^ the coefficients for plants B, and C 
being .96, .93, and .86 respectively. In plant A, when "hazards" is added, 
the multiple correlation becomes ,97 and when "education" is added it 
becomes .98. In plant B, when "initiative" ia added the correlation ia 
increased to ,96 and when "responsibility for tlic safety of others" is 
added, the value is .96. For plant G, the multiple correlations arc in- 
creased to .91 and .93 with the subsequent inclusion of "hazards" and 
"initiative." 

It should be pointed out that in none of the three plants did the II 
start to shrink when the third variable was added. However, the high 
value of the correlations, plus the fact that the increment resulting from 
the addition of the third variable is so email, makes further application of 
the technique seem unnecessary. The difference between these incre- 
ments added to the R^s by the third selected items as compared to the 
metement that would havo been added by other items^ is so small that 
coneideTaWe sampling error could be present, For example, in Plant B, 
when the correlations are carried to a third decimal place, the addition of 
"responsibility for the safety of others" to "experience" and "initiative" 
increases the R from .963 to .982, an increment of ,009. Other items 
would have increased the obtained R by pevhapa ,007 or .008. It 

* Williom H. Stead, Carroll L. Sliartle; et qI, OcQMpdiional connseUnf) iechniques, pp. 
245'-262, !New York'. The Amorican Book Coiapany, 1940. 
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then tliat too much importance should not be attached to the particular 
item that was added last. In spite of this fact, however, Table 1 shows 
a certain consistency from plant to plant in the particular items that were 
selected. In the three variables selected, '^expericiico or learning time'^ 
appears in all plaiiis, always first, while “hazards'^ and "initiatives^ each 
appear in two of the plaiils^ 

Acmracy of Prcdiciion. Tabic 2 lists the standard errors of estimate 
for predicting tlie total point rating in each plant from one, two, and three 


Table 2 

iSlandiird KrrorH of KsLimute for Predicting Total Point 
IliitiiiKB from Selected Scale Items 


Selected Items 

Plant A 

Plant ]) 

Plant C 

O'clll, 

% 

O'cfll. 

% 


% 

Best Single Item 






61 

Best Two Itei«.s 






42 

Best Three Items 

■81 


■■ 

27 


36 


items in the rating scale. For example, tlie standard eiTor of estimating 
the total point rating for a particular job from the best three ibeme is 
11.4 in Plant A, 13.0 in Plant B, and 3,8 in Plant C. In other words, in 
Plant A, tlm estimates for approximately two-thirds of the jobs are within 
11.4 of the total point rating baaed on all eleven factors. The percentage 
figures in Table 2 indicate the proportional size of the errors in terms of the 
standard deviations of the several distributions. 

Practical Implications of Grade Placement 

Application of Abbreoiaied Scale. In the plants studied, how many 
jobs would actually be shifted insofar as rates of pay are concerned if an 
abbreviated scale were used? Is the standard error of estimate of 11.4 in 
Plant A practically significant? This question can best be answered 
through an analysis of the changes that would actually occur if only three 
items were used. 

Prediction Formula. Plant A has been selected as an example. TJa- 
ing the data from this plant, the regression equation for predicting total 
points from "experience or learning time," "hazards," and "education" 
was found to be : 

Xtp ^ 30.4 “1“ 1.4E)tp. "H 5'4nBB. “h 2,0Eduo. 

Point ratings on "experience or learning time," “hazards” and “educa- 
tion" were substituted in the formula for each of the 247 jobs in the plant 
to obtain the computed ratings. These computed values arc shown 
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plotted against the total point ratings (eleven itoma) in the scafctergram 
(representing the previously mentioned R of .98) in Figure 1. Super- 
imposed over the scattergram are eleven shaded areas, each representing 
a different labor grade. For example, jobs which “rate'* from 144 points 
to 165 points are in the second labor grade. Any job which falls inside 
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total point .nATINO - ELEVEN iTEMS 

Fta. 1. Graph ahowing ratings computed from three Bcnk iteiuB plotted iigainst 
total point Tatings (all eleven itema) for 247 jobs in Plant A. 'The eleven shaded areas 
dehiiQ the labor grades designated by the numbered arrows, 

a shaded area is placed in the same labor grade by both the original scale 
and the abbreviated eenJe^ and any job which foils in an unshaded Aroa 
would be displaced one or more labor grades by the abbreviated scale. 

Labor Grade Displacement. Table 3 shows that of the 247 jobs in tliis 
particular plant, 153 or 62% would remain in the same labor grade, 92 
or 37.2% would be displaced by one labor grade, while only 2 jobs or 
0.8% would be displaced two labor grades. Table 3 also shows the 
number of jobs deviating by varying numbers of points, classified as 
^'same labor grade, ''displaced one labor grade,” and '^displaced two 
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Tablo 3 

DiEJcrcimiicics between ToUl Point ItatingH (Eleven Itemi?) and 
IlfttingH Computed from Three iLcme for Plant A 


Points 

of 

Deviation 

No. of Jobs by Labor Grncio Displacement 

Ha me 
Labor 
(iradc 

Displaced 
One Labor 
(Irtidc 

Displaced 

Two Labor 
Grades 

All Jobs 

0^ 

08 

0 


77 

5-0 

18 

27 


75 

10-14 

20 

28 


48 

15-10 

11 

21 


32 

20-2-i 

0 

2 


8 

25-29 


4 


4 

30-31 


1 

1 

2 

35^0 



1 

1 

Totals 

153 

92 

2 

247 

labor grades.*' 

This table and 

the data from which it was 

prepared 


reveal that only seven jobs deviate from their original placement by more 
than 22 points, the range of most of the labor grades. The fact that only 
seven jobs have point differences greater than the difference between the 
highest rated job and tlie lowest rated job in any given grade, is additional 
evidence of the comparability of the two Bystems, 

Wage Structure Conaidcrations 

Range of Rales. Examination of the rate schedule (Table 4) in Plant 
A tends to minimize the practical importance of such differences as would 

Table 4 


llate Schedule For Plant A 

Labor 

Grade 

Point 

Range 


Rates 


Starting 

One 

Mouth 

Two 

Months 

Maximum 

1 

Up to 144 

.05 

70 

.75 

.81 

2 

145 to 100 

.05 

70 

.75 

.87 

3 

107 to 188 

.70 

75 

.80 

.93 

4 

180 to 210 

.75 

80 

.85 

.09 

5 

211 to 232 

.80 

85 

,90 

1.05 

5 

233 to 254 

.85 

00 

.05 

1.11 

7 

255 to 270 

.90 

Of) 

1.00 

1.17 

9 

277 to 208 

.05 

100 

1.05 

1.23 

9 

200 to 320 

1.00 

105 

1,10 

1.20 

10 

321 to 312 

1.05 

no 

1.15 

1.35 

11 

343 and up 

1.10 

115 

1.20 

1.11 



182 


C. H. Lawshe, Jf. 


exist between the application of the original scale and tlie abbreviated 
scale. The rate of $1.05 per hour, for example, ie the maximum rate for 
jobs in labor grade five and is earned by employee.^ on some jobs which 
are evaluated as low as 211 points. On the other Imiid, 31,05 is the 
starting rate for labor grade ten and ia paid to some employees on jobs 



TOTAL POINT RATIMO - ELEVEN ITEMS 

Fig. 2. Graph showing point range of jobs which at cue time or another carry a rate of 
$1,05. Note that only seven ioha fall in one ahacled band but not in the other. 


that axe evaluated as high as 342 points. This rate^ then of $1.05, may 
be paid at one time or another to employees on jobs ranging through six 
different labor grades and evaluated at from 211 to 341 points, To be 
sure^ a progression system is used and varying amounts of time are spent 
on jobs in these several labor grades when the $1.05 rate is paid. How- 
ever, the fact that a particular rate does occur in six consecutive labor 
glades tends to minimize the practical significilncc of a few points of 
difference on the scale. Figure 2 shows that nearly every job that falls 
within the 211 to 342 point range on one scale also falls within the same 
range on the other, 
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The Reliability of Point Ratings 

Practical Dijficullies, The reliabilities of the original ratings in the 
three plants investigated are not known just as they are not known in 
any plant, It is impractical if not impossible to obtain re-ratinga of jobs 
by a second jury of equal competence or of equal familiarity with the 
jobs. For this reason, it is impossible to determine whether or not the 
correlation between the complete scale and the abbreviated scale is as high 
as the reliability of the scale itself. Needless to say the reliability of 
human judgments rarely attains the magnitude of the correlations pre- 
sented in Table 1, whetlicr they be jiidgmenta of personality traits or 
of physical phenomena. 

Table 5 sheds some light on the reliability problem. In a fourth plant, 
the same jury of aupervisors and analysts rated a group of five jobs on 
March 16, rerated them on March 22, and again rated them on April 7. 


Table 5 

Point Rntingfl nntl Corresponding Riitcfl for Five Jobs Rated nt Three DilTercnt Times 



First Ilntiag 

Second Ruling 

Third Rating 

Maximum 

Change 

Job 

Points 

Rale 

Points 

Rate 

Points 

Rate 

Points 

Rate 

A 

^135 

.05 

305 

.01 

335 

.85 

100 

.10 

B 

405 

.02 

330 

.84 

295 

.81 

110 

.11 

G 

315 

,83 

2eo 

-78 

245 

.77 

70 

.06 

D 

355 

.87 

370 

.88 

380 

.80 

25 

.02 

E 

330 

.84 

380 

.80 

380 

.89 

50 

.05 






Mean Change 

71 

.05 


The table shows that the fluctuations in point ratings ranged from 25 to 
110 points with an average change of 71 points, while the corresponding 
rates that would be paid for jobs with these point values showed changes 
ranging #.02 to $.10 per hour with an average change for the five jobs 
of #.05 per hour. Perhaps the jobs changed; perhaps the analysts ac- 
cumulated additional information for the subsequent ratings; perhaps 
the analysts improved; or perhaps they got tired. Whatever the reason, 
the point values did fluctuate. The fact of these fluctuations further 
minimizes the practical importance of a few points in this particular job 
rating plan. That there is high agreement between the original system 
as it functions in the three plants and the abbreviated system is a fact. 
Whatever the amount of deviation, there has been no intention to imply 
that either the original scale or its abbreviation is the criterion against 
which to measure the other. Such deviations from perfect reliability as 
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are fllmoafc certain to exist force the conclusion that the complete scale 
and an abbreviation of it yield results which in terms of practical operation 
are almost identical. 


Summary and Conclusions 

Job rating data from three different plants wore subjected to the 
Wherry-Boolittie selection teclmique following the intercorrclation of 
points awarded on each item. The three items yielding the highest R 
with the total point rating from eleven items were identified for each 
plont and a more detailed study of Plant A was made. The following 
conclusions are supported; 

1. In each of the three plants, the "experience or learning time" item 
in the scale correlated highest with the total point rating arrived at from 
eleven items, the r’a being .96, .93, and .86. 

2. The R for the combination of the three optimum scale items Avas 
found to be .98, .96, and .93 for plants A, B, and C, respectively. 

3. The items, "hazards” and "initiative” each appeared twico in the 
optimum three items in the plants studied. 

4. If the three item abbreviated scale were employed in Plant A, 62% 
of the jobs would remain in the same labor grade, 37.2% would be dis’ 
placed one labor grade, and 0.8% would bo displaced two labor grodes. 

5. Such deviations na exist betivcen point ratings as.signed by the 
original scale and by the abbreviated scale seem practically unimportant 
in terms of the magnitude of the range within any given labor grade, the 
flexibility of the plant wage schedule itself, and the probable unreliability 
of the ratings. 

6. A simplified scale consisting of three or four items rvoiild probably 
yield results that are practically identical Avith those obtained by a more 
complex system and would greatly reduce the time consumed by the 
rating activity, 

Received June 30, tOU. 



The Value of Aptitude Tests for Supervisory Workers in the 
Aircraft Engine and Propeller Industries 

John T. Shtiman 

)riWaws)3or( Technical InaliluU, WilliamapoTl, Pennsylvania 

What the future holda for any company depends in a large measure on 
the ability, vision, and leadership of those in supervisory and executive 
positions. Management today is quite generally free from too great 
dependence on lule-of-thumb and the shrewd-guess method of operating. 
Time consuming engineering efforts bring new designs into being, provide 
the tools and other facilities required for manufacture of an article. Yet 
the problems involved in the selection and training of men as supervisors 
have received inadequate attention. Generally industrial managers 
would not countenance such thoughtless procedures iu the handling of 
raw materials as are sometimes used in the selection and development of 
supervisors. This part of the investigation, however, is confined to only 
one phase of this problem — ^thnt of reporting the results obtained in com- 
paring certain test scores with the job success of the supervisors studied. 

In their present state tests are not wholly adequate for predicting 
supervisory success. However, teats and rating scales do provide good 
and effective bases from which to start, or checks by which to gauge 
decisions. Supervisory and executive ability arise from the interaction 
of many different qualities and abilities, and no single test will measure 
entirely the many qualities and abilities involved. 

Method 

The' foremen, assistant foremen, set-up men, and group leaders as 
the case may be, were tested in small groups. These men were already 
working as supervisors when given the tests; hence, it is safe to assume 
that some form of natural selection had already taken place in most 
instances. 

The rating sheet illustrated here was used to secure a fairly objective 
rating on the job success of each supervisor tested. These ratings were 
made by superiors of the supervisors studied. No more objective meas- 
ures of job success wore available which would have been even relatively 
free from possible distortion by factors beyond the control of the super- 
visor. It is true, of course, that the study therefore is valid to the extent 
that the ratings represent a true picture of the job success of these indi- 
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vicluals. Relatively few ratings of "poor" were secured, probably due to 
the reluctance of auperiora to so rate the men. For this reason, many of 
the comparisons will be made between the "cxccUent" and "average" 
ratings, In other words, the percentage of excellent ratings will be used 
to determine the efficacy of the testa. Tins procedure is justified for 
several reasons; 1. The small proportion, of poor ratings. 2. The prob- 
able operation of the so called "halo elicct" among tlve average ratings. 
3. The excellent foreman is the one in whom we are most interested. 

Experience in giving these tests to groups of foremen indicates that 
giving tests to groups of older employes is not too desirable a practice if it 
is at all possible to test all employes at the time they are hirod. Since a 
man or woman applying for a position is usually willing to take a tost, no 
problem of morale is involved because of the possibility of imminent 
decisions affecting the man's job in the near future. 


Eating Sheet Used in Rnting Supervisors 



Date- 



- 

Name— 





Posi fcion 





Bated 





1, Prod notion; Consider whether work 

Above 

j_ 

Average 

J 

lieJow 

generally moves through. tUia de- 

Average 



Average 

partnient on Echhdule, Borap and re- 

Good 



Poor 

work, 





2 . Handling workers i Oonaider diaci- 

Above 

j_ 

Average 

1 

Below 

plinef extent to which this man haa 

Average 



Average 

difficulty with his men; attitude of 

Good 



Poor 

men toward company policies ^ etc. 





3, Condition and maintenance of depart- 

Above 

±. 

Avorago 

j 

Below 

ment; Good housekeeping, safety, 

Average 



Average 

condition of Diaflhinea, 

Good 



Poor 

4. General: In general and from all as- 

Above 

_L 

Average 

J 

Below 

pects how would you rate. 

Average 



Average 


Good 



Poor 
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Table 1 prcseutH a auinmary of rcoommendcd minimum critical scores 
and the percentage of improvement effected in the selection of foremen 
at the three maiuifacturing plants studied, 

Table 1 

Summary of Hoc om mended Minimum Critical Scores and Improvement Effected 
ill Selection of Foremen, All Plants 


Per Cent Improvement in 

Mijiiinnm Critical Score lC,vcc]Jciifc Jlatings 


Test 

Ly- 

comin(( 

{N^m 

American 

Propeller 

{N=m 

Spencer 
Ileater 
(AT -24) 

Ly- 
coming 
(A^ = 90) 

American Spencer 
Pi-opellcr Heater 
[N = m (AT -24) 

Otifl Q.S, Test of 

Mental Ability Beta, A 

33 

30 

32 

9 

6.4 

42 

Minnesota Paper 

Form Board, AA 

24 

34 

13 

8 

6.4 

21 

Bennett Test of 
Mccliniiical 
Comprehenflion, A A 

30 

30 

25 

10 

8 

12 


The per cent ijnprovcmeiit effected in the selection of roremen was 
greatest at the Spencer Heater Plant and least at the American Propeller 
Plant with the results at the Lycoming Plant between the two. It ie 
significant, however, that an improvement in selection would be possible 
at each of the three plants with all of the tests used. 

Table 2 summarizes the results with group leaders and joh-settera at 
two of the plants. The third plant, Spencer Division, had no supervisors 
in this category. The percentage of improvement in seleotion possible at 
both the plants represented in Table 2 is rather high. The results secured 

Table 2 

Summary of Rccommonded Minimum Critical Scores and the Improvement Effected in 
Selection of Job-Settera and Group Leaders, All Plants 


Minimum Critical Per Cent Improvement 

Score in Excellent Ratings 


Teat 

Lycoming 

(N=25) 

American 
Propeller 
(AT = 60) 

Lycoming 
{N = 25) 

American 

Propeller 

(/V-60) 

Otia Q.S- Test of Mental 
Ability Beta, A 

34 

34 

17 

24 

Minnesota Paper 

Form Board, Revised, AA 

30 

24 

30 

12 

Bennett Teat of Mechanical 
Comprehenaionj AA 

30 

27 

47 

14 
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here with the group lenders in the American I^rojKiller Corporation are 
much higher and more positive then those secured in the same company 


for foremen and reported in Table 1- 

As indicated in Table 3, the use of those three tests would improve 
generally the selection of excellent supervisovs by 15 to 20 per cent. 

Table 3 

Average Improvement Effected in Selection of Excellent SniKrviaors,* 

All Plants, All SiiperviaoTe, N =■ 297 

Teat 

Mean Improvomcnb in 
Selection Excellent 
Supv. nt Mmimum 
Critical Scorea 

Mean Improvement 
in Selection of 
Excellent Supv. 
nt Qj 

BennefcbTeat of Mechanical 
Comprehenaion, AA 

18% 

20% 

Ofcia Q,S. Teat of Mental 
Ability Beta, A 

10% 

17% 

Minneaofca Paper 

Form Board, Kevised, AA 

15% 

17% 


♦ Includea all BUperviaora: foremen, aaaiatant foromon, group lendera, cud job aettena, 


In Table 4 statistically signiheant correlations were secured on tlic Otis 
teat in the Lycoming and Spencer Heater plants; on the Demiett teat iu 
the Lycoming and Spencer plants; and on the Minnesota Paper Form 
Board in only the Lycoming plant. No statistically significant correla- 


Table 4 

Summary of CorrelationB between Job Ratings end Test Resulte, 
Foremen ^ncl Aaaistont Foromont, All Planta 



Job Rating 'with Raw Scores 

Teats 

Lycoming 
Division 
(AT -09) 

Amoricaii 

Propeller 

Corporation 

(A-80) 

Sponccr 

Heater 

Division 

{y-24) 

Obia Q.S, Teat of 

Mental Ability 

Beta Toat, A 

.39 ± .07 

,05 ± .09 

.66 ± .12 

Minneflota Paper 

Form Board, 

Revised, AA 

.47 ± .07 

.08 ± .00 

.14 =t .04 

Bennett Test of 
Mechanical Com- 
preliension, AA 

,463 ± .07 

.02 ± .00 

.65 i .12 
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fcions were secured on any one of the three teats at the American Propeller 
Corporation Plant. 

Table 5 aummarizes the correlations obtained on the group leaders and 
job Betters. The correlations with but one exception are significant. 
This one exception, an r of .37 ± .10, on the Bennett Teat with the 
American Propeller Corporation group leaders, approximates a significant 
correlation. Again, the re.sultB with this group of American Propeller 

Table 6 


Summary of CorrolationB bobwecii Job Hatinga and Teat Reaulta^ 
Group Leadens and Job S^btenr, All Plants 


Teat 

Job Rating with Teat Scores 

Incoming Atnorican 

Division Propeller 

(i7*25) (iv=ao) 

Otia Q.S. Test of Mental 
Ability Beta A 

,4G ± .14 

.54 ± .08 

Minaeflota Paper Form 
Board, Revised, AA 

.60 ± .13 

.30 d: .00 

Bonnott Test Mechanical 
Comprehension, AA 

.73 ± .10 

.37 ± .10 

1 ■ , - - 

Table 6 

Mean Correlations bolween Job Ratings and Test Scores, All Supervisors, All Plants 

Test 

Mean Biserial r's 
Supervisors All Plants 
iN=2d1) 

Mean Biserial /a 
Super visors All Plants 
Except Aincr. Prop. 
Foremen * 

(i7 = 208) 

Bennett Test of 
Mechanical Com- 
prehension, AA 

.46 zb .04 

.55 zb .04 

Otia Q.a. Test of 

Mental Ability 

Beta, A 

.42 ± .04 

.61 i .046 

Minnesota 

Paper Form Board, 
Revised, AA 

-33 ± .04 

.30 i .05 


* The results secured with the Poremen, American Propeller Corporation, did not 
coincide with those secured for the other four groups of auperviaors including the Group 
Leaders from the same Company. Since these results wore so much out of line^ the 
author is taking the liberty of using n mean in this column which excludes this group. 
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Corporation aupervisors arc much more positive tlitin the resulta reported 
for the foremen of the same company and reported in Table i. 

Averaging the r's secured with all supervisory groups yields the results 
shown in Table 6. The Bennett Test proved to be the most effective, the 
Otis Test next most effective, and the Minnesota Tost tho least effective 
of the three* 


Conclusions 

1. Job-success on supervisory work was found to ho related positively 
and significantly to the test scores in these three dissimilar industrial 
plants engaged in some phase of metal working. It is significant that 
each of these plants was entirely different from the others in the product 
manufactured and the character of work performed in the plant. It is 
reasonable to conclude that supervisory work iu theso different plants 
has some factors, skills, or aptitudes in common measured by the tests. 

2. The promotability of minor supervisors such as group leaders and 
job setters was found to be related positively and significantly with tho 
test scores. 

3. The means obtained by the foremen and group lenders on the tests 
at Lycoming were below those obtained by workmen in the more skilled 
job categories in the factory. This is probably due to the effect of addi- 
tional experience and service of this group; that is, years of experience 
on the job count heavily in recommendations for promotion. Further- 
more, the tendency of individuals of superior ability to leave routine jobs 
would have a tendency to drain off many capable individuals before they 
had acquired a sufficient background of experience to be given the respon- 
sibility of Bupervisoiy work. 

4. It is also logical that tests might well be utilized to survey a plant in 
order to determine whether its supervisory force measures up to recog- 
nized stondards. In other words, the results indicate that there are levels 
below which the supervisory force of a plant should not fall. In this way, 
the proper testa would become one objective measure of a supervisory 
force, almost wholly dissociated from experience. 

Received Match 11), 1944* 



Relationship between Interests and Abilities: A Study of the 
Strong Vocational Interest Blank and the Zyve 
Scientific Aptitude Test 

Louis Long 

iSiufieni Perionnd Bureau, College of the City of New York 

If the vocational counselor is to do an adequate job he must constantly 
seek to discover relationships between the various techniques that he 
uses. The present study arose from speculation about the relationship 
between interests and ability na determined by tAvo standardized tech- 
niques: Tlie Strong Vocational Interest Blank (6) and the Zyve Scientific 
Aptitude Test (8). Since most studies have reported a slight positive 
relationship between interests and abilities the question arose as to 
whether or not students who rated high on the scientific scales of the 
interest blank would do better on the Scientific Aptitude Test than stu- 
dents who rated low. Casual inspection of scores as they were discussed 
in interviews suggested that there was a positive relationship and the 
results of tliis study confirm this impression. 

Such a relationship is certainly to be expected if the two techniques 
measure what they purport to measure. In this connection it should be 
mentioned that there is some question os to \vhat the Scientific Aptitude 
Test measures (2). Only a slight relationship has been found between 
the scores on this test and college grades (1, 4). Nor does there seem to 
be any great amount of comraunality between the Scientific Aptitude 
Test and tests of general intelligence (1). If this test is measuring scien- 
tific aptitude it is to be expected that students who rate high on the Strong 
scales for engineers or physicists would make, on the average, higher scores 
on the Scientific Aptitude Test than do students who rate low on the scales 
for these occupations. If the Scientific Aptitude Test is measuring scien- 
tific ability it can also be anticipated that there is a greater degree of rela- 
tionship between scores on this test and high ratings on the "scientific 
scales” of the Strong questionnaire than betrveen scores on this test and 
high ratings on the "nonscientifio scales” of the Strong questionnaire. If 
such hypotheses are verified by an analysis of the scores on the two instru- 
ments it can then be inferred that the Scientific Aptitude Test is measuring 
some phase of ability that separates students who have interests similar 
to the scientist from those who do not have interests similnr to the scien- 
tist. Consequently a more positive relationship between the Scientific 
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Aptitude Test and the scientific scale of the Strong than between the 
Scientific Aptitude Test and any other scale of the Strong would suggest 
that the two instruments Bhould be used to supplement each other in 
guidance work. 

Scores Used in the Statistical Analysis 

Strong has published norms not only for the individual occupations 
but also for groups of occupations (6). At the Student Personnel Bureau 
of the College of the City of New York it haa become standard practice 
first to score the Strong blank against group occupational keys. If a 
break down of any group is desirable this can be dono later. This pro- 
cedure greatly reduces the scoring time and on the basis of the reported 
correlations between the group occupational keys and the individual occu- 
pational keys this short cut seems justifiable (5, 6), The occupational 
groups and the occupations included in each arc listed in Table 1. Since 


Table 1 


List of Occupations Included in each of the Six Occupalional Groups 
of tho Strong Vocational Inlereab Blank . 


Group 1- Technical Non-mathematics 
Artist 
Architect 
PaycKologht 
Phyaioiati 
Dentist 


Group 4. Business Detail 
Accountant 
Office Worker 
Put chasing Agent 
Banker 


Group % Technical MatbematicB 
Mathematician 
Engineer ' 

Chemist 

Physicist 

Group 3. Welfare 

Y. M, C. A. Physical Director 
y. M. C. A. General Secretary 
Personnel Worker 
Social Science Teacher 
City Scliool Superintendent 
Minister 


Group 6. Business Contact 
Sales Manager 
Beal Estate Salesman 
Life Insurance Salcamim 

Group 6. Verbal 
Advertising Man 
Lawyer 
Author 
Journalist 


this study is primarily concerned with the Strong questionnaire aa a tool 
for use in guidance work, the statistical treatment will bo oriented around 
the letter ratings that Strong uses to indicate the degree of coiuinon inter- 
est between the individual and a particular occupational group. The raw 
scores could have'been used, but it was thought that the results would be 
more typical if the letter rafcinga were employed. In several places 
throughout the report a division has been made between students obtain- 
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ing nn A or B+ rating and those obtaining a B, C+, or G rating, 
Thia dichotomy is arbitrary, but aiich a division is often made in counsel- 
ing on tlie basis of Strong^a suggestion that “a person should consider 
Bcriously those occupations in which he receives A or B+ ratings before 
entering some other occupation'* (G). 

The total score of the Scientific Aptitude Test has been used through- 
out this report. The scoring procedure recommended by Zyve (8) was 
followed. 


Subjects and Test Scores 

Scores on both the Strong Vocational Interest Blank and the Scientific 
Aptitude Test were availablo for 200 students of the College of the City 
of New York. Each student had sought advice from some staff member 
of the College's Student Personnel Bureau and at the suggestion of the 
latter had taken both the Strong and the Zyve. Scores on the Thurstone 
A. C. E. Psychological Examination were also available for these students. 

Results 

The average score on the Scientific Aptitude Teat for each letter 
rating of the six occupational groups will be found in Table 2. For 
example; the average score on the Scientific Aptitude Test for students 
obtaining an A rating on the Strong Technical Non-mathematieg group 


Tabic 2 

Relationflhip between Scorca on Zyve Soiontific Aptitude Test and Ratings 
on Strong Vocationnl Iiitcreat Blank 


Occupational 

Groups of 

Strong 

Average Score on 

ZyVo Test According to Categoriea of Strong 

A 

B+ 

D 

B- 

c + 

G 

Tech. Non-Mftth. 

107.4 

00.5 

93.5 

03.0 

100.0 

95,0 ^ 

Tech. Math, 

111.4 

108.3 

88.2 

90.8 

01.9 

87.4 

Welfare 

06.7 

101.0 

98.9 

105.2 

92.0 

119 . 8 * 

BuBincBS Detail 

84.1 

103.4 

93.0 

07.2 

07.0 

106.6 

llusincsB Contact 

88.8 

82.4 

04.8 

09,7 

105.2 

107.6 

Verbal 

04.5 

97.0 

100.0 

101.9 

104.9 

H6 . 4 *' 


* Average based on less than 10 coses. 


was 107.4, A positive trend will be noted in the case of the Technical 
Non-mathematics and Technical Mathematica groups; a negative trend 
is found in the case of the Busineas Contact and Verbal groups; but no 
definite trend is apparent in the two remaining groups; Welfare and Busi- 
ness Detail. To form some idea of the significance of these trends the six 
steps on the Strong scale were consolidated into two steps: ratings of A and 
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Table 3 


Reliability of the Difference between Average Scores on Zy ve Scientific Aptitude Test for 
High and Low Ratings on Strong Vocationol Interest Blank 


Occupational 
Groupa of 

Strong 

Subjects with Ratings of Subjects with Katiiiga of 
B-h or more on Strong B or less on Strong 

/^-valuo 
of the 
DifTcrenco 
between 
Averages 

V 

Average 
Score on 
Zyvo Test 

AT 

Average 
Score on 
Zyve Teat 

Tech. Non-math. 

no 

104,2 

00 

93.6 

<.0I 

Tech. Math, 

07 

109.9 

103 

80.G 

<001 

Welfaro 

108 

98.7 

02 

100.4 

>,00 

Bugineas Detail 

24 

94.5 

170 

100,1 

>,30 

Business Contaot 

34 

65.4 

lOfl 

102.4 

<.001 

Verbal 

84 

oe.o 

110 

102.0 

.10 


B + and ratings of B or less. The average score on the Scientific Aptitude 
Teat for students falling into these two categories will be found in Table 3. 
The reliability of the difference between the averngeg was determined by 
using Student's i-Teat (3). The P-values presented in Table 3 indicate 
that in three of tlie six cases such difference between the averages would 
be expected to occur by chance less than five times in IQO. Using this 
as a criterion of a significant difference we can say that the following trend 
ia signifi^cant: students scoring high on the Scientific Aptitude Test rate 
higher on the Strong Technical Non-mathematics and Technical Mathe- 
matics groups, but lower on the Business Contact group than do tlioso 
scoring low on the Scientific Aptitude Test. 

Table 4 

Bi«serial CoTrolationa between Scores on the Scientilic Aptitude Teat and Ratings on 
ationg Vocational Interest Blank (B+ or more versus 'B or leas) 


Occupational Groups 

Bi'scrial 

of Strang 

Correlation 

Teoh. NoiMnath, 

0.20 

Tech. Math. 

0.60 

Welfare 

-0.04 

Business Detail 

-0.12 

Buaiaesa Contact 

-0.87 

Verbal 

-0.14 


If the Scientific Aptitude Teat ia positively related to any occupational 
group of the Strong scale it would be expected that the Tedmical Matlic- 
matica group would be the moat likely one to show this relationship. The 
second most likely group would be the Technical Non'-mathematieg. Pos- 
itive relationships wei^ found in both inatnneea. The extent of the 
relationship ia, however, greater for the Technical Mathematics group 
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since the P-valuc in one case is 0.001 and only 0.01 in the other. This 
difference can also be In'ought out by calculating a bi-serial correlation 
between scores on the Scion tide Aptitude Test and the categories of B + 
or more versiis II or less o]i the Strong scale, When this is done a bi-serial 
r of 0i50 is obtained for the Tcclmical Mathematics group and one of 0.26 
for the Teclinicttl Non-inatiuunatica. (The coiTcIabions for the other 
occupational Rroups will be found iii Table 4.) 

The negative or chance relatioiiHliip between the ratings on the four 
other occupational group.s and scores on the Scientific Aptitude Test 
Btrengtliens the above finding since there ia no reason to expect a direct 
correBpondcncc between tlic two techniques in these cases. 

In an effort to determine whether the students with high scorea on the 
Technical Mathematics grou]) of the Strong scale were just superior 
students or “high flcorcra“ the same analysis was applied to the total score 
made on the Tlruvstone A. C. E. Psychological Examination. Of the 
200 students in the preceding compariaonSj 95 took the 1938, 1939, or 1940 
edition of the Thurstoue test. The scores on the 1938 and 1940 editions 
were converted into 1939 equivalent scores by using the table supplied by 
Tliurstono (7). The average scores on the Thuratone teat for students 
obtaining an A, U+, B, B — , CH-, or C rating for the six occupational 
groups of the Strong scale will bo found in Table 5. The absence of 


Table 5 

Rolfttionflhip between Scores on Thu ra tone A. C. E. Paychologicnl Examination (1939) 
and Ilalingg on Strong Vocational Interest Blank 


Occupational 
Groups of 

Strong 

Avorago Score on Thumtone According to Categories of Strong 

A 

B+ 

B 

B- 

C-f- 

C 

Tecli. Non-math. 

1240 

111,4* 

124.7 

114.3 

135.3* 

132.0* 

Tech. Math, 

121.3 

129.8 

120.0 

121.8 

132.9* 

120.6* 

Wolfaro 

125.0 

127.4 

118.0 

127.5* 

122.0* 

116.6* 

Busifieas Detail 

110.1* 

110.7* 

126.1 

118.7 

123.1 

124.4 

Buflinesa Contact 

145.0* 

100.8* 

122.0 

127.1 

121.1 

110.3 

Verbal 

120,8 

121.7 

120.0 

120.5 

111.7* 

116.0* 


* Average baaed on less than 10 caaca. 


definite relationships between scores on the Strong scale and scores on the 
Tliurstone teat is clearly evident, except in the case of the Verbal group. 
When the average Thurstoiic score for students rating high on the Strong 
scales was compared with the average Tliurstone score for students rating 
low on the Strong scales a significant difference was found only in the case 
of the Verbal group (Table 6), It seems logical to expect a relatioaship 
between the ratings on the Verbal group of the Strong scale and the scores 
on the Thuratone test, since the latter ia so highly verbal 
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Table 6 


Reliability of the Difference betwou AvemBQ Scores on Tlmretono A. C. E. Psychological 
Exainination for High and Low Ratinga on Strong Vocational Interest Blank 


OccupatioriBl 
Groups of 

Strong 

Subjects with Ratlnge ol SubjecLs with Ratings of 
D-f- or more on Strong D or loss on Strong 

P-vftlue 
of the 
Difference 
between 
AvernEes 

N 

Average 
Score oi\ 
Thuretoiio 

N 

Avertigo 

Score ou 
Tliurstono 

Tech. Ncrt\-mntl\. 



40 

m.8 

>.40 

Tech, Math. 



60 

122.8 

>.80 

Welfare 



40 

120.4 

>.10 

Duginesd Detail 



85 

124,2 

>.10 

Business Contact 



8Q 

122.0 

>.60 

Verbal 


■■ 

66 

119.3 

<.06 


Summaty 

The jeJatioBship between interests and scientific ability as measured 
by the Strong Vocational Blank and the Zyve Scientific Aptitude Test 
was investigated. Use of the occupational group scales on the Strong 
disclosed that in three of six groups there was a reliable difference between 
the average score on the Scientific Aptitude Teat for students rating high 
on the interest questionnaire and for those rating low, The iindingB indi- 
cate that students scoring high on the Zyvo Teat rate higher on the Strong 
Technical Non-mathematics and Technical Mathematics groups, bub 
lower on the Business Contact group than do tliose scoring low on the 
Zyve Teat. In order to rule out the possibility that these results were duo 
to the selection of superior students the same analysis was applied when 
scores on the Thurstone A, C. E, Psychological Examination (1939) were 
aubatibuted for scores on the Zyve Scientific Aptitude Test, No definite 
relationship between scores on the Thuratone test and ratings on the 
Strong scales was found except in the cose of the Verbal group. 

The results indicate that the Zyve Scientific Aptitude Test is measur- 
ing some phase of ability that separates students having interests similar 
to those found among the occupational groups included in the Technical 
Mathematics and the Technical Non-mathematics groups of the Strong 
from those students who do not have interests similar to those found in the 
above oGGupational groups. From the common eense point of view the 
agreement between the twp measurements is to be expected. The Zyve 
Test deals largely with problems involving mathematics and principles of 
physics. Even when the items are intended to measure general abilities 
(such os reasoning, generalizing, and suspending judgment) the content of 
the item ia usually drawn from the physical science field. Similarly, in- 
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spectioii of the keys of tlic Strong Technical Mathematics and. Technical 
Non-inallicmatics scales reveals that the items dealing with scientific and 
tficlinicnl fltihjcets or atitivilias nro heavily weighted. Consequently some 
agreement betweeu the two instruments would be expected. The extent 
oI this agreement, Innccver, is far from perfect. For example, there is not 
enough agreement to permit the prediction of a score on the Zyve Scien- 
tific Aptitude T’est from a rating on the Technical Mathematics scale of 
the Strong. It is, therefore, concluded that the use of both of these 
instruments in counseling is better procedure than the use of either one or 
the other if the capacity of a student to do work in engincBring or science 
is under consideration. 

Recewed Maj/ Iff, 
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The Measured Interests ot Marine Corps Women Reservists * 

Milton E. Hahn, Captain, USMCR, ** and Corcella T. Williams, 
Major, USMCWR 

Jleddquarlers, U. S. Mannn Corps, Washington, I). C. 


A fundamental purpose of the whole Marino Corpn' fiyatem of person- 
nel classification is the assignment of each individual to the typo of mili- 
tary duty where he or she can soonest and most efficiently vServe the 
Marine Corps. In the accomplishment of this purpo-sc, and a.s a pre- 
liminary to military assignment, each recruit is tested, interviewed, and 
given an opportunity to express his "choice of d\ity"; and nil of the in- 
formation thus obtained is recorded on his Qualification Card, Form 940, 
In this way, his basic aptitudes, his education and work experience, his 
special skills, and at least a crude indication of his interests become avail- 
able as a basis for determining the most appropriate military assignment 
for each Marine. 

Civilian occupational backgrounds of women enlisting in the Marine 
Corps supplied extremely useful data for proper assignment to militoiy 
duty, but were at times misleading, or inadequate. For example, many 
school teachers and clerical workers joined the Marino Corps to escape 
fiom their civihan jobs. Many of the younger women joining the Corps 
had little, if any, previous work experience, and therefore, possessed no 
specific occupational skills. Others had considerable experience and had 
even developed a high degree of skill, but in a specialty so unrelated to 
any of the jobs open to women in the Marine Corp.s, that this experience 
was of little help in determining appropriate military aBsigninenta. Fi- 
nally, many of the occupational specialties performed by women Re- 
servists in the Marine Corps could not he significantly differentiated by 
available estimates or measures of basic aptitudes, 

These facts made it obvious that in many instances a crucial factor in 
determining a military assignment would have to be a woman's interest in 
doing a particular type of work. This waa especially true for women who 

* This report is part of a atudy made by tUo authors for Iho Clasaificatiun Division, 
Dotoil Branch, Poraonnel Department, USMC, Headquarters, Wnsliington, D. C. The 
opitviona or osaettiona oonlaintd in thia artinie ata tho ptWaic ontB ol tiro authoiB and 
nro not to be construed as olKcial or reflecting the views of tho Navy Department or the 
naval service iit large. 

♦♦Dr, M. E. Hahn is now Director of the Psychologionl Services Center at Syracuse 
University, Syracuse, N. Y. 
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had no apeclal occupational Hkillw, and for women who possessed occupa- 
tional skillH which could not be used directly in military duties. The need 
for a valid estimate of interests was equally great in selecting women for 
assignment to certain military jobs in which large numbers of women were 
needed Injt for wliicli special training had to be arranged because so few 
women entering the service liad had relevant previous experience. 

A search was necessary, therefore, for tools and techniques which could 
be utilized to bring about the assignment of women in the Marine Corps 
to duties for which they would not only possess the necessary minimum 
aptitudes and skills but in winch they would also be interested and satis- 
fied, and tlicrcfore, able to perform with greater efficiency. 

In the early stages of the Marine Corps Women^s Reserve program the 
only technique used for determining the interests of individuals was the 
interview. For most of the enlisted women this amounted to little more 
than one or two direct questions about ^'choice of duty*^ inserted at the 
end of the classification interview, A minority of each recruit class (those 
being considered for a few special types of military assignment) were 
reinterviewed to obtain a more precise description of their previous ex- 
perience or to permit a cleMcr expression of their interests. Although the 
information relative to interests derived from interviews was helpful in 
making assignments to duty in the Marine Corps, a year of experience 
demonstrated the need for supplementary screening devices. Interviews, 
if they were to yield significant information on interests, were time- 
consuming; interviewers were variable in the reliability and validity of 
their judgments; and the claimed interests of the women, expressed 
merely as a preference for a specific military assignment, often had little 
or no validity as an indication of real interest in actual work activities. 

A study of the situation was authorized by the Director of Personnel, 
Headquarters, United States Marine Corps, in March, 1944. The study 
included tliree major aspects: (1) the job satisfaction of female personnel 
in selected military occupations ; (2) the measured interests of women in 
military occupations; and (3) a comparison of claimed and measured 
interests of women performing military duties in the Marine Corps. This 
report is concerned with the second aspect of the study, the measured 
interests of women now performing certain military duties. 

It was decided to select for study a sample of women Reservists cur- 
rently assigned to several widely different types of military duty. Mat- 
ters of expediency limited the selection to those most readily available 
for testing. All of the women included in the study here reported were on 
duty either at Marine Corps Headquarters, Washington, D. C., or at the 
Marine Corps Air Station, Cherry Point, North Carolina. 

Descriptive data on 667 enlisted women Reservists in the study are 
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Norms for men are used for \VK standard scale scores in the Marine Corps. GCT Forms C and D; MAT-3. 
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presented in Table 1.^ (Three groups of women officers were also in- 
cluded in the atiidy of measured, interests but are not included in this 
table.) No marked differences are noted among groups in age or years of 
education. The mean age of motor vehicle operators is somewhat higher 
than the average age for the total group— 27.4 vs. 24.6 years. The mean 
age for aviation machinist mates is somewhat lower than the mean age 
for the total enlisted group— 22.C vs. 24.6 years, Otherwise, the groups 
are relatively homogeneous in so far as age and years of education are 
concerned. 

The Army General Classification Test, Forms c or d, and the Army 
Mechanical Aptitude Test, Form 3, are administered to all women Re- 
servista. Norms for Army men are used. The minimum education 
requirement for enlistment in the Marine Corps Women’s Reserve, com- 
pletion of the twelfth grade or the equivalent, has resulted in a mean 
standard scale score of approximately 111 for enlisted women in the 
GOT. The mean GOT score for the enlisted sample discussed here is 
114,0 somewhat above the mean of 102 obtained by enlisted men. 

On the GCT, synthetic training devices instructors, stenographers, 
and the composite group of, miscellaneous occupations labelled “Other” 
were above the group mean with respective means of 121,0, 117.8, and 
119,2; standard deviations for these groups were similar to the one for 

the total group. w .i. 

The only sub-group with a mean appreciably lower than, that for the 

total group was Cooks and Bakers (mean 102.5). This group was also 

the most variable in the GCT scores. 

Scores on the Army Mechanical Aptitude Test Form 3 showed no 
significant differences between means for the military occupational sub- 
groups and the mean for the total sample except for aviation machinist 

mates. The ^ for the total mean and that for the aviation machinist 


mate sub-group was 3.93. 

Civilian occupational backgrounds of these enlisted women were het- 
erogeneous. The IGl women Reservists assigned to duty as clerk-typista, 
for example, came from 25 different civilian occupation^ 

Two interest testa or inventories were considered. The Strong Voca- 
tional Interest Blank, althougli it is the best validated and most widely 
used interest inventory, was impracticable from the etandpomts of scoring 
costs and complexity of interpretation. The Kuder Preference Record, 

•Dkeropmoies in ihe luimbcr of oMca leporled between Tiblo 1 and Table 2 are 

omiaod bv cortttin rocordfl being unavailable for various renaons. 

3Th6 Kudsr Preference Record Jotfn BB. Science Uescnrch AssocmtcB, Clucago, 
IllinoiB. 
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although it is a comparatively new instrument, offered advantages in the 
simplicity of its administration, scoring, and interpretation. The Kuder 
Preference Record, therefore, was used to measure interests. 

The Kuder Preference Recerrd contains nine scales which are purported 
to measure intensity of interest in nine broad areas of occupational ac- 
tivity. These nine areas are; (I) mechanical, (2) computational, (3) 
scientific, (4) persuasive, (5) artistic, (0) literary, (7) musicol, (8) social 
service, and (9) clerical.® 

This test is taken by punching with a stylus two of six possible choices 
for each item. Scoring is extremely simple. Single unit weiglits are used 
for scoring the items. The nine scores on the Preference Jlecord yield an 
interest pattern or profile for the respondent. Adequate interest profile 
norms are not available for civilian occupational groups. 

The test was standardized with the assumption that significant sex 
differences did not exist. The validity of this assumption can be tested 
by a comparison between the original norms, based upon a mixed group 

Tabic 2 

Means and Standard Deviations for 791 USMCWH on fciio Nine Scales 
of the Kuder Preference Record, Form BB = B16) 

Mcaiifl Standard Deviations 


Kuder Kuder - 


Kuder Seales 

USMCWR 

l^orms * 

USMCWR 

Korma * 

X — — 

itn 

Mechamcal 

69.1 

63. 

20.18 

18. 

1.070 

Computational 

29.9 

30. 

12.02 

10.6 

.864 

Sflientific 

57.9 

51. 

15.79 

13.8 

.828 

Persuoaive 

61. 

71.B 

16.08 

13.8 

.635 

Artistic 

55.2 

49, 

16,74 

16,3 

.009 

Literary 

64.1 

57. 

16.39 

15.6 

.875 

Musical 

23.2 

25.5 

9.69 

10. 

.559 

Social Service 

78,1 

72. 

18.00 

17. 

1.006 

Clerical 

61.6 

60. 

16.48 

15.5 

,901 


* Means and atnndard deviations for the Kuder Norm group were estimated from 
percentile norms on the Profile sheet based upon the assumption tJmt distributions were 
normal, 


of college men and women, and the average scorea of the Marine Corps 
Women Reservists. These comparisons are presented in Table 2. Al- 
though data on Kuder's original standardization group were not available 
for proper tests of the significance of differences between means, tentative 

■ Manual for the Kuder Preference Record, Science Research ABsociates, Chicago, 
Blinois. Unfortunately, the present manual (June 1944) for the Preforence Record is 
inaccurate and misleading. Those interested in the inventory ate referred to the bib- 
liography nt tlie end of this report. 
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tests were made based on tlie assumption that distributions for Kuder'e 
norm group were normal. These data are presented in Table 3. The 
null hypothesis was not refuted. 


Table 3 

Dccilo Norma for 701 Adult Women, USMCWR, on the Nine Scales 
of the Kuder Preference Record 


Raw Score 


Dcdlcs 


Kuder Scales 

10 

20 

30 

40 

50 

60 

70 

80 

90 

lOO 

Range 

Mechanical 

33 

40 

40 

52 

57 

63 

71 

78 

80 

109 

21-116 

ComputatioJiftl 

14 

IB 

22 

2fl 

29 

32 

35 

39 

47 

05 

6- 69 

Scientific 

30 

43 

48 

53 

67 

61 

66 

71 

79 

06 

26-102 

Perauaaive 

41 

47 

51 

55 

60 

64 

00 

74 

81 

108 

29-112 

Artistic 

34 

41 

46 

50 

64 

58 

63 

69 

76 

95 

21- 98 

Literary 

34 

40 

44 

40 

63 

67 

02 

67 

75 

93 

23- 96 

Musical 

10 

14 

17 

20 

23 

26 

20 

32 

30 

40 

3- 71 

Social Service 

53 

00 

07 

73 

78 

83 

89 

95 

102 

120 

30-122 

Clerical 

31 

30 

41 

45 

51 

50 

60 

66 

73 

07 

17-100 


Table 3 contains decile raw score norms for the 791 women who coni' 
pletecl the Preference Record. Intercorrelations were computed for the 
nine scales included in the inventory, These data are presented in Table 
4. With five exceptions — mechanical vs. scientific, mechanical vs, lite- 
rary, mechanical vs. clerical, computational vs. clerical, and artistic vs. 
social service — there is little evidence that correlations among the scales 
depart markedly from zero in bo far as this sample is concerned. 

Military occupational sub -samples of women Reservists in the Marine 
Corps were compared etatisbically. These aub-sampleg were: Officer, 
line; Officer, staff; Officer, technical specialty; Aviation Machinist Mate; 
Assembly and Repair (Aviation); Motor Vehicle Operator; Cooks and 
Bakers; Synthetic Training Device Instructors; Stenographer; Clerk- 
typist; Clerk, general; Duty Non-Commissioned Officer; and Other.^ 

Means and standard deviations for these military occupational groups 
are presented in Tables 5 and 6 respectively. 

Time did not permit a comparison of the mean of each occupational 
group with the mean for every other occupational group. The mean for 
each occupational group wns^ however, compared with the mean for the 
total sample. The Preference Record did differentiate most of the occu- 

^ TJic '^Otlipr" group consiated of 122 cjwes in military occupatioiis the samples for 
which wore too Hmall or the occupation of too little importance to warrant Bcparate 
treatment, DiflLributiuns for this occupational composite closely appro^ximated those 
for the total somplo. 
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An r of .112 is significant at the 1% level 
An T' of .0S5 is significant at the 5% level 



Table 5 

Mean Scores for 12 Occupational Groups of Woinen, MCWIl, on the Nine Scales of the Kuder Preference Record 
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Table 7 

Significance of the Differences between Means ("i”) of Each of 13 Occupational Sub-Samples and a Sample of 
791 Adult Women (MCWR) on the Nbe Scales of the Kuder Preference Record 
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pational groupa from gGnerO'Hty on one or more scales despite the fact tliat 
data for the sub-group were not removed from the generality for the 
comparisons. Occupational groups not differentiated Bignificautly from 
generality by at least one of the nine scales were officer^ — staff, cooks and 
bakers, and synthetic training devices instructors. Table 7 presents ^7'a” 
for differences between means for each occupational sub-gioup and the 
total sample for each of the nine interest areas, 

Table 7 ia of particular interest because it illustrates a phenomenon 
which has not received much attention in the literature concerned with 
the measurement of interest— "rejection'' or ''aversion" scores. The 
topic is not particularly germane to this report, but attention ia called 
to the fact that occupational groups are as clearly differentiated on interest 
scales by their "rejection" scores as they are by their "acceptance" or 
"interest in" scores. Bingham’s statement that a C grade obtained on an 
occupational key of the Strong Vocational Interest Blank means 
may need change to "No, for that occupation; yes, for some others." ^ 

The rejection of items positively weighted for the clerical scale may be 
as important to the measurement of an interest in the duties of an Aviation 
assembly and repair worker as the acceptance of items positively weighted 
for the mechanical scale. 

The preliminary aspect of this investigation was a study of job satis- 
faction which indicated satisfied and dissatisfied groups of workers. 
Scores on the Preference Record scales were separated for these satisfied 
and dissatisfied groups. Scores on tho inventory for these two groups 
showed marked differences between them on one or more interest scales. 
Tables 8 and 9 present these data for three groups of clerical workers. 
These tables make it obvious that occupational norm groups for a test of 
interests should be composed only of those who are satisfied with their 
jobs. Groups so constituted in this study have interest profiles much 
more clearly differentiated from the total standardization groups than 
sub-samples containing a large proportion of individuals disinterested in 
or dissatisfied with the type of work they are doing. 

Conclusions 

Although the major purpose of this report is to present norms, and 
statistics related to these norma, certain conclusions of general interest 
are presented here* 

^ Bingham, Vf. V., ApliCudes and aptitude tealing. Harpers, 1037. Appendix, Section 
IX, p. 356, 

*KonQ of the other military occupationnl sub-sampleB contained enough dissntisBed 
workers to make an analysis of this sort possible or necessary. 
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1. Certain occupational sub-samples of women Reservists in the 
United States Marine Corps can be differentiated by scores on various 
scales of the Kuder Preference Record. 

2. In the case of three sub-groups of clerical workers— stenographers, 
clerk-typists, and clerks, general— certain scales on the Preference R.ecord 
differentiate satisfied from dissatisfied workers. In each of these three 
sub-groups, the satisfied workers are more clearly differentiated from the 
total group of 791 than are sub'groups containing both satisfied and 
dissatisfied clerical workers. 

3. "Rejection” (low or negative) scores on certain scales differentiate 
occupational groups from the generality as markedly as do the “occept- 
ance” (high or positive) scores. 

4. Group differentiation is a matter of patterns or profiles which are 
characterized by both "acceptance” and "rejection" scores. 

5. Comparison of individual profiles with occupational sub-sample 
profiles permits a surprisingly good interest screen for use in the assign- 
ment of women Reservists to military duty. 

ReceivedJuly S, ISU. 
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Personality Patterns of Adolescent Girls: I. Girls Who Show 
Improvement in IQ * 

Dora F. Capwell 

Trainea Acceptance Center, Public Schook, Pillshurffh, Pa. 


The reBearch described in this report was designed to discover what 
differences there are between those adolescent girls whose IQ's change 
significantly upon retest and those whose IQ’s show only alight changes. 
Its purpose, therefore, is to throw additional light upon the problema of 
individual, clinical diagnosis, which inevitably involves or at least implies 
prediction of a future level of performance. The determination of what 
factors within the individual affect test scores is a more narrowly defined 
problem than the one of mere constancy of IQ, measured in terms of group 
data, and is, of course, significantly related to accuracy of diagnosis, which 
is preliminary to the planning of effective educational and social treatment. 

Literally hundreds of studies have been reported which contain retest 
data from intelligence tests. They have been reviewed and summarized 
by Baldwin (2, 3), Burks (6), Foran (9, 10), Nerazek (24), and Thorndike 
(31). Although the studies have dealt with all age levels, various time 
intervals, several different teats, and a wide variety of testing conditions, 
the coefficients of correlation between test and retest have ranged from 
.63 to .95, most groups showing correlations of .84 or better. Treated by 
the correlation technique, the data consistently showed high positive cor- 
relation between test and retest, and hence the authors assumed that they 
demonstrate the relative constancy of the IQ. 

The studies which are of special interest here are the ones which at- 
tempt to determine the causes of change in level of test performance in 
those cases which showed variability of IQ. These may be divided into 

* The writer is indebted to tlie Department of Psychology, University of Pennsyl- 
vania, and particularly Dis. Malcolm G. Preston, Francis W. Irwin, and Milos Murphy, 
who served as research advisers in the final stagea of the work, for advice and constructive 
ontioism. 

Gratitude is due to the Bureau of Psychological Services, State of Minnesota, whioli 
sponsored the study. Valuable assistance was given by the late Dr. Fred Kuhltnann and 
his succesaor, Di. Stuart Cook, The staff ol the State School for Girls at Snuk Centre, 
Minnesota, and the Sauk Centre Public Schools gave their wholehearted cooperation. 

Dr. Starke R, Hathaway, UniveTsity of Minnesota, made the Multiphosio Personality 
Inventory available to the writer before its publication and was helpful throughout the 
period of collecting data. 
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three groups : studies which include special analysis of the extreme cages in 
the distribution of IQ changes (7, 13; 20, 22, 25, 32), studies made on 
selected groups of problem children (5, 12), and studies of the effect of 
specific factors, such as attitude, emotion, and psychopathic personality 
(5, 11, 10, 19, 23, 27, 28). All of these studies have been characterized 
by a lack of objective data aside from the intelligence test scores. Most 
frequently causes of IQ variability have been assigned by surveying the 
history, considering the events which have taken place between tests, and 
making a highly subjective judgment. No study reported convincing 
evidence that personality factors are functionally associated with changes 
in IQ on retest, although many authors drew that conclusion from what ia 
hem considered insufficient evidence. 

The present study attempts to present a more objective description of 
the individuals studied by utilizing scores on a variety of tests, analyzing 
items of possible significance in the history, and also analyzing the record 
of personal-go cial events which occurred between examinations. The use 
of both a normal group and a definitely maladjusted group permits a more 
thorough exploration of the significance of a wide variety of concomitant 
factors. Although the study was planned to investigate factors related to 
IQ variabilitUi the results led to a study of those whose IQ improved as 
compared with those whose IQ remained relatively constant, Three 
major questions will be asked of the data. 

(1) Are there significant differences of personality and experiential 
background ‘between those adolescent girls whose IQ shows significant 
improvement and those whose IQ changes only slightly? 

(2) Is significant improvement in the IQ of adolescent girls related 
to improvement in the adjustment pattern of the total personality? 

(3) Are the relationships which are investigated first in a delinquent, 
institutionalized, adolescent, female group demonstrable in a non-deiin- 
quent, adolescent, female group in the community? 

Procedure 

Subjects. The subjects were 101 delinquent girls and 85 non-delin- 
quont girls who were between ages 12 and 18 and whose IQ on the first test 
was not less than 60. The delinquents were consecutive admissions to 
the Minnesota State School for Girls, beginning in September, 1941. 
The non-delinquents were in the consolidated public school at Sauk Cen- 
tre, Minnesota, and were chosen from grades which would match the 
usual grade distribution of girls entering the State School. Tlie principal 
selected every other girl from the grade lists until the necessary number 
was obtained. The groups were roughly equated for urban-rural back- 
grounds. Both schools have a population which is about two-thirds 
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urban and one-third rural, when their places of residence are classified 
according to the TJ, S. Census criterion of urban and ruraL 

The method of selection resulted in two groups of the following descrip- 
tion, The delinquents ranged in age from 13 to 19 with a median age of 
16. The non-delinquenta ranged from 12 to 18 with a median ago of 15. 
The alight diffei’ence in age range is a reflection of the fact that the delin- 
quents show more school retardation, so that their average age for each 
grade is a little older. The median grade placement of tho delinquents 
was 9th grade ; 86% were in grades 7 to 10, inclusive, 12% were above 10th 
grade, and 2% were below 7th grade. The median grade placement of 
the non-delinquents was also 9th grade, with 94% in grades 7 to 10, 
inclusive, and 6% above 10th grade. 

Collection of Data. The data consist of test scores obtained on two 
psychological examinations, items of classification from the personal- 
social history, and items of classification related to progress between 
exarainations, The delinquents were examined the first time within their 
initial two weeks at the School, and the second examination was given 
from 6 to 16 raonthg later. The non-delinquents were examined the first 
time in the fall of 1941 and were re-examined from 4 to 13 months later. 
The tests given at both examinations were the Kuhlmann Tests of Mental 
Development (18), the Minnesota Multiphasic Personality Inventory 
(14), the Washburne Social Adjustment Inventory (33), and the Pressey 
Interest -Attitude Test (26). Three tests which each subject took only 
once were the Terman-MUes Test of Masculinity-Femininity (30), the 
Vineland Social Maturity Scale (8), and the Stanford Achievement Teat 
(17). Three testing sessions were used to complete the entire battery for 
each examination. All of the tests were administered by the writer with 
the exception of the delinquents^ Stanford-Achievement Tests, which are 
given routinely by the school principal at the State School, 

From the personal-social history of the delinquents tabulations were 
made of the occupation and education of parents, national and racial 
background, language spoken in home, work experience, length of time 
out of school, type of delinquency, and other sooial problems within the 
family. Information on the non-delinquents was obtained by personal 
interviews and from the school records regarding occupation and educa- 
tion of parents, language spoken in the home, work experience, and any 
social problems in the family. For the delinquents there were also Home 
Ratings made by the State School field workers on a large proportion of 
the cases. 

For the interval between testa the record of the delinquent cases 
included health status, school grades, discipline reports, and ratings of 
work habits and general, conduct made by the housemother, work super- 
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visor, and supervisor of home life. For the non-delmquenta there was a 
record of health history and school grades. The latter were recorded 
from the principars records, and the student's report on health was 
checked by records in the office of the school nurse. 

Results 

Intelligence Test Results, The Kuhimann Teats of Mental Develop- 
ment were used as the measure of intelligence, and, hence, the main 
characteristics of these tests should be kept in mind when examining the 
results. When applied at the age levels used in this study, the scale 
consists of sixteen tests, all of which are timed, and all of which are scored 
at successively higher levels, depending upon the amount accomplished 
in a given time interval, usually two minutes. Five of the tests demand 
the use of spatial relatione and of spatial imagination. The others are 
more strictly verbal. Each test is given- a time score and an accuracy 
score as well as a mental age score. Sixteen is the highest chronological 
age denominator used in computing IQ's. The results of these groups 
are summarized in Table 1. 


Table 1 

Kuhliuann Teals of Kental Davelopment 



Delmqwcxvta 


on-Deliiiq\i6nta 



Mean IQ S.D. 

<7771 

Mean IQ 

S.D. 

erm 

1st Test 

87.40 17,10 

1.70 

101.88 

17.69 

1.00 

2nd Test 

95.0S 10.02 

1,G5 

111.70 

20.50 

2.22 


The non-delinquents are significantly brighter than the delinquents on 
both tests. D/irD on the first test is 5.70, and on the second one it is 6.46. 
Despite the difference in mental level, each group showed about the same 
amount of shift in IQ on tho second test. The average amount of change 
was an increase of 8 points for the delinquent group and 10 points for the 
non-delinquent group. 

The coefficient of reliability was computed with the test-reteat scores 
for each group. Product moment correlations also were computed to 
determine the relationahip of IQ changes to time interval, change in speed 
flcore, change in accuracy score, and level of first IQ (Table 2). The 
time interval between testa and the change in accuracy score had a negli- 
gible relationship to the changes in IQ, but there was a marked relation- 
ahip between speed score and changes in IQ. The reliability coefficient is 
high enough to be considered satisfactory for a teat used for individual 
diagnosis. It is of interest in passing that these are the first reliability 
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coefficients reported on the Knhlmann Teats of Mental Development.^ 
The correlation between IQ change and level of fimt IQ is so low that no 
relationship between them is indicated, implying that the distribution of 
changes at varioua IQ levels is not affected by the IQ level itself. 


Table 2 

ProductrMoment Correlations Baaed on tho Results from the Kuhlmann 
Testa of Mental Dovelopraent 



Delinqucnis 

Non-Delinquents 

Teat-re teat reliability 

,90 ± .01 

.88 ± .01 

IQ ohangG and time interval 

-.02db.0fl 

,06 ± .07 

IQ change and change in accuracy score 

.18 ± .00 

.15 ± .07 

IQ change and change in speed score 

.44 ± .05 

.41 ± .06 

IQ change and level of first IQ 

.08 ± .06 

.15 ± .07 


We find that the IQ's of approximately 36% or 36 of the 101 delin- 
quents changed more than 10 points, and 48% or 41 of the 85 non- 
delinquents changed mote than 10 points.^ Inasmuch as the standard 
error of a score is 5.4 for the delinquents and 6,7 for the non-delinquents, a 
change of more than 10 points would occur by chance only 6 times in 100 
for the delinquents and 10 times in 100 for the non-delinquents. A 
change of more than 10 points, then, with this group may be congideved a 
significant change. In presenting the results of the other tests, we shall 
divide each major group into two subgroups— those whose IQ changed 
10 points or less, called the constant group, and those whose IQ changed 
more than 10 points, These latter groups should be thought of as vari- 
able groups in contrast to the constant ones, but since only one delinquent 
and one non-delinquent had IQ's which regressed more than JO points, 
the remainder really improved, and the groups are essentially groups 
which showed significant improvement in IQ as against those whose IQ 
did not improve. Hence, the variable groups will be designated the 
improved groups. 

Achievement Test ResuliSn In. the case of all three achievement scores 
the delinquents have a lower grade level of achievement than the non- 
delinquents, and in both of the major groups the constant IQ group has a 
lower achievement level than the improved group. Table 3 demonstrates 
these relationships, not in terms of absolute achievement test scores, but 
in terms of the relation of the individual's achievement level to his actual 
grade level The actual grade level of the non-delinquents was figured on 

^ For a diSGU^sion of why they were omibted m the original report of the Kuhlmann 
Testa, see (18), pp. 16^17. 

^D/<rDp for thoao two percentages is 1,71. 




Table 3 

Difference between Actiial Grade Level and Achievement Grade Score ■ 

Delinquents t Non-Delinquents 
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the basis of the time of the school year when the test was given, and in the 
delinquent group it was figured as closely as possible by the grade place- 
ment at the time of the year when the girl left school. The difference 
between actual grade level and the achievement test score gives a ^'differ- 
ence achievement score/' These have been averaged for each group and 
are presented in Table 3, When compared with the norms for the Stan- 
ford Achievement Test, each group shows some retardation in grade 
achievement. It should be recognized, however, that this is true partly 
because the ceiling of the test is too low for a few of the group who were in 
loth, 11th, and 12fch grades and who made scores above the maximum 
grade level of the test. No doubt the critical ratios between delinquents 
and non-delinquents would be slightly higher if the norm did not stop at 
the 11.0 grade. 

Personality Test Results. The results of the other tests used in the 
battery provide data for answering the first question posed; namely, are 
there significant differences of personality, as measured by this group of 
personality testa, between those adolescent girls whoso IQ's show signifi- 
cant improvement and those whose IQ's show only alight variability? 

The Minnesota Multiphasic Personality Inventory is scored on eleven 
scales, three of which are checks on the validity with which the subject has 
answered the Inventory. These are the scores for L, and F, The 

score is the Burn of items put in the “Cannot say'' category rather than 
answered as true or false. L ia a lie score, which if too high, shows that 
the subject is attempting to present too favorable a picture of himself. 
The F-score is a check on how many extremely unfavorable items are 
included in the score; it includes items which normally are affirmed by 
only a few cases in a thousand. Althou'gh the F-score tends to go up as 
maladjustment ificreases, an extremely high F-score suggests carelessness, 
lack of comprehension, deliberate falaificatioUj or scoring errors. The 
other eight scales are measures of specific abnormal tendencies, grouped 
under familiar psychiatric classifications. Their letter abbreviations have 
the following meanings: Hs— hypochondriasis, D— depression, Hy— 
hysteria, Pd — psychopathic deviate (formerly called psychopathic per- 
sonality), Pa^pavanoia, Pt — psychasthenia, Sc — schizophrenia, and Ma 
—mania. 

Table 4 shows the significance of difference between the subgroups of 
each major group. The ratios do not indicate a significant difference 
between the results for the constant and improved groups, but the test 
did .discriminate extremely well between the delinquent and non-delin- 
quent groups, The differentiation which this scale and the other per- 
sonality tests made between delinquents and non-delinquents will be 
presented in a subsequent report. 
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Table 4 

Minnesota MuUiplinaic Personality Inventory— Significance of Differences of Haw Scores 


Scale 

Delinqiienta, Diff. 
between Improved and 
Constant Groups 

Non-Delinquents, Diff. 
between Improved and 
Constant Groups 

First Test 
DIaD 

Second Test 
DIaD 

First Teat 
DIaD 

Second Test 
DIaD 

?-Scoro 

.12 

.55 

,27 

1.03 

LrScore 

.48 

.01 

,71 

1.00 

F-Scorc 

3.30 

2.07 

.76 

1.21 

Hs-Scorea 

.20 

1.90 

.35 

.53 

D-Scorcs 

.00 

.40 

.61 

1.04 

Hy-Scorea 

1.75 

.02 

1.06 

1.13 

Pd-Scoreg 

.30 

.62 

.22 

.24 

Pa-Scores 

.61 

1,60 

.25 

.67 

PtrScorea 

.00 

1,35 

.43 

-64 

Sc-Scorea 

.43 

1.18 

.50 

.14 

Ma'ScorcB 

1,20 

.13 

2.25 

2.03 


The same treatment has been given the scores from the other per- 
sonality tests, namely, the Wnshburne Social Adjustment Inventory, the 
Preasey Interest-Attitude Test, and the Termen-Miles Test of Mascu- 
linity-Femininity. The Vineland Social Maturity Scale is a different type 
of teat from these others, but may be grouped with them, and Table 5 


Table 5 

Other PerBoiittUfcy Tests— Significance of Difference of Raw Scores 


Teat 

. 

Delinquents, 
Diff. between 
CJonstant and 
Improved Groups 
DIaD 

Kon-Delinqucnts, 
Diff. between 
Constant and 
Improved Groups 
DIaD 

Wnabburne 

iBt 

.60 

1.06 

Washburne 

2nd 

.40 

,06 

Pressey 

Ist 

2.79 

.15 

Pressey 

2nd 

3.59 

.12 

Tcrman-Milca 

(one only) 

1.22 

.78 

Vineland * 

(one only) 

.49 

.21 


* DfaD between social quotients. 


ehowa the significance of differences between each group on both examina- 
tions. The Washburne, tlie Terman-Mile.s, and the Vineland do not show 
significant differences between the constant and improved groups. That 
the Pressey shows high critical ratios between the constant and improved 
delinquents but not the non-delinquents and does not discriminate be- 
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tween the total group of delinquents and non-dclinqueuts appcaie to be 
a chance phenomenon. The Termnn-Miles showa no significant differ- 
encea between any groups. 

Personal Histonj. The second part of question (1) ia: arc there signifi- 
cant differences of background between those adolescent girls whose IQ 
showed significant improvement and those whose IQ varied only slightly? 
The first item on which they are to be compared is the occupational level 
of the father. In cases where the father is deceased or not with the 
family and the mother works, the occupation of tlie mother was rated. 
The occupations were claasified according to the Taussig (29) scale, which, 
has been used by Hildreth (15) and others, Chi square was computed, 
in a five by two table, to find out if there is a reliable difference in the 
distribution of occupational level of parents between delinqiicnta and non- 
delinquents and the constant and improved subgroups of each. Between 
parental occupations of delinquents and non-delinquents P-value is less 
than .01. Application of cbi square to constant and improved delinquent 
groups yields a P"Value of .60, and applied to constant and improved non- 
delinquent groups the P-value is .04. 

The indications are, therefore, that there is a reliable difference be- 
tween the occupational level of the parents of the delinquents and non- 
delinquents, the occupational level being higher for the parents of non- 
delinquents. There ia not a reliable difference between occupational 
levels of the constant and improved delinquent groups, but with the 
non-delinquents the difference approaches significance, the parents of the 
improved group tending to have a higher occupafcional level than those 
of the constant group. 

The parents' education is another item which was investigated as far 
as possible with each group, but the educational information ia more 
limited than the occupational information. In only 47 of the 101 delin- 
quent cases and 77 of the non-delinquenta was it possible to obtain in- 
formation regarding parents' education. The chi square test was applied 
in a four by two table and yielded a P-value between .01 and ,02 between 
the education, of the delinquents' parents and the parents of the non- 
delinquenta, indicating a reliable difference in favor of the non-delinquents. 
The subgroups within the two larger groups are so small, due to the 
incompleteness of the data, that chi square is not an appropriate test of 
differences, and for the same reason more elaborate treatment does not 
seem indicated. 

Differences in race, nationality, and Language were so small as to he 
insignificant in all groups. Only nine of the delinquents and one non- 
delinquent had one or both parents of foreign birth. Pive of each major 
group were not of the white race. Thirteen delinquents and two non- 
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delinquents came from bi-lingual homes. These few girls were about 
evenly distributed between the constant and improved groups. Work 
experience is another factor which differed markedly between delinquents 
and non-clelinquonts, the delinquents having worked more, but it had no 
apparent significance with respect to the two IQ groups. 

By means of the records at hand and personal interviews an attempt 
was made to tabulate any social problems within these girla^ families, 
including problems of health, mental retardation, mental instability, and 
social maladjustment, such as delinquency or criminality. Of the delin- 
quents 72% of the constant IQ group had social problems within the 
family and 72% of the improved group. Of the non-delinquents 23% 
of tlie constant group and 20% of the improved group had family problems 
of the types mentioned. Again the same pattern is seen ^Yhe^ein there is 
conspicuous difference between delinquents and non-delinquents but little 
or none between subgroups of each. 

Three additional items were tabulated for the delinquents only. The 
type of delinquency was not related to IQ changes, inasmuch, as 91% of 
the constant group and 94% of the improved group were committed for 
Bex delinquency. Ratings on the home conditions of the delinquents were 
made by field workers from the State School who visit the home of each 
girl who has been committed. They used an adaptation of the Whittier 
Scale for Grading Home Conditions (34), which includes ratings on Neces- 
sities, Neatness, Size, Parental Conditions, and Parental Supervision. 
The ratings were examined to see if those girls whose IQ improved after 
a period in the institution came from the poorest or moat unsatisfactory 
homes. There were no striking differences between the homes of the 
girls in the two subgroups- Ratings on the first three categories covered 
the entire range, but on the latter two, Parental Conditions and Parental 
Supervision, there Avas piling up on the unfavorable end of the scale. 
The third item considered for the delinquents only Ams the length of time 
out of school prior to commitment. The Kuhlmann Tests are pencihand- 
paper tests, much like school Avork, and it Avas thought that a girl who had 
been out of school for some time might find it easy to better her score after 
a return to school. However, classifying the girls^ length of time out of 
school in a four part table and applying the chi square test, a P-value of 
between .70 and .80 Avas obtained, so there is no evidence that length of 
time out of school prior to taking the tests had any relation to ability to 
improve the score. 

Peraonaliiy Tests {Changes from First to Second Examination). The 
second major question to be ansAvered is Avhether significant improvement 
in the IQ of adolescent girls is related to improvement in the adjustment 
pattern of the total personality. Our data for answering this question are 
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the amount of change in the scores of tlioae three personality teats wliich 
were given twice and the relation of these changes to cliangcs in IQ. 
A second type of data is the analysis of personal-social events between 
examinations. 

The amount of change in scores on the personality tests wag averaged 
for the various groups and compared. Table C shows that changes in 


Table 6 

Significanco of DlfTeronce between Wean Changes 
of ScoTe on M and 2ncl Pcreonality Testa 


Test 

DIoD 

Changeg of Constant 
and Improved 
Delinquciita 

D/tfD 

CliaiiRfis of ConfltQnt 
and Improved 
Non-Delmqucnts 

Minnesota Multiphasic 
?-Scoro 

1.02 

,63 

L 

.40 

.33 

F 

1,30 

.68 

Hb 

1.90 

.21 

D 

1,63 

2.05 

Hy 

1.17 

2.00 

Pd 

1,28 

.20 

Pft 

1.82 

.31 

Pt 

1.49 

.39 

Sc 

.83 

.10 

Ma 

1.80 

.35 

Waabburne S. A. Inventory 

1.38 

2.40 

Pressay Intereat^Attitudo 

.87 

.00 


personality adjustment ag measured by scores on this group of personality 
tests occurred no more frequently in the improved groups than the 
constant groups. More detailed examination of tlie score changes shows 
that there was a slight but consistent tendency for the delinquents* scores 
to shift more toward the mean for the normal population, on the second 
teat, but the average change was so slight and also so evenly distributed 
with relation to constant and improved groups that it is not of significance 
for the present problem. 

PeraoTia^SocicJ Ridoyy in Interual between Tests. Health frequently 
is mentioned as a cause of changes in teat performance. The health 
record for the delinquents was available at the School. With the non- 
delinquents A classification was made on the basis of the report of each 
girl on number of illnesaes, which was checked by records of the school 
nurse, who attempts to record causes for each absence resulting from ill- 
ness. In the delinquent groups 23% of the constant IQ group and 45% 
of the improved IQ group received treatment for major health conditions, 
including pregnancies. Chi square applied to all classificationg yielded a 
P-value between .10 and .05, and D/<rD between the major treatment 
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categoriea of each group was 2.24. Although there is JittJe likelihood of 
of the difference occurring by chance, neither teat quite meets the criterion 
for a reliable difference. Twenty-six cases in the entire group were fitted 
with glasses between examinations. They were about evenly divided 
between the constant and improved groups, but their average IQ change, 
however, was 11 points, which is 3 points higher than the average, 

The chi square test applied to the classification of health history for 
the non-delinquents yielded a P-value of .30, as compared with about .08 
in the delinquent group. No direct comparison between delinquents 
and non-delinquents can be made because of the lack of uniformity in the 
type of records, but there is more evidence tliat health was a significant 
factor in the delinquent than in the non-delinquent group. 

School grades of both delinquents and non-delinquents were analyzed 
in terms of trends in the interval between psychological examinations. 
Thirty-five of the delinquents had no school experience in this period, but 
of those who did there was no significant difference in the trend of their 
grades between the constant and improved IQ groups. In the non- 
delinquent group, too, the trend of grades in terms of improvement or 
the lack of it was no different in the improved than the constant IQ group. 

Three other factors were examined in the delinquent group as possible 
indicators of adjustment within the institution, namely, records of disci- 
pline, work ratings, and behavior ratings. These are records kept rou- 
tinely by the institution. The average number of disciplinary incidents 
for the constant group was 6.32 per person, and for the improved group 
it was 7.25 per person. Classification of types and quantity of discipline, 
tested by chi square, yielded a P-value between .20 and .10, which is not 
low enough to allow one to draw any definite conclusion about the group 
differences. When work ratings and behavior ratings were classified in 
terms of trends of improvement, lack of improvement, or poorer than 
before, the percentage of girls in each classification was almost identical 
for the constant and improved groups. Hence, it is not indicated that 
the group whose IQ improved showed any more improvement in adjust- 
ment to the institution than those whose IQ remained constant. 

Discussion 

The basic criterion for grouping these cases, of course, was the differ- 
ence in the scores made on two intelligence testa. On the first test the 
delinquents proved to be somewhat below average, which is consistent 
with other reports of the intelligence level of delinquents, but the non- 
delinquents had a mean intelligence score close to the mean for the general 
population. The test-re test reliability coefficient was satisfactorily high 
on each group, but slightly better with the delinquents than the non- 
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delinquents. The correlation between IQ change and time interval is ao 
close to zero that it is impossible to say that the large changes in IQ are 
due to practice effect in the usual sense of the term^ since that would 
result in a negative correlation between time interval and IQ change. 
Yet, 36% and 48% of each group, respectively, showed a change of more 
than 10 points in IQ on retest. This result, while indicating more change 
than that reported by many investigators, notably those using the 1916 
Stanford-Binet, is by no means unprecedented. Lowell (21) with her 
very large group of cases reported that 71% changed 7 points or more, 
suggesting that the mean change must have been considerably greater 
than that, Brown (5) reports an average change of 6 points, which ia 
only slightly below the average for this study, and Allan and Young (1), 
using the Terman-Merrill, report results identical with the ones of this 
study which used the ICuhlmann. They found an average gain of 8 
points with 48% of the group varying more than 10 points. Variability 
such as these studies and the present one reveal is not simply variation 
around the mean inasmuch as the average change is a gain of 8 or 9 points, 
when computed with retention of the sign rather than change averaged 
regardless of sign. This gain is not to be explained by the conventional 
techniques of correlating IQ change with time interval or level of first IQ, 
as mentioned before. The range of IQ changes is quite similar whether 
baaed on the cases retested at 4 to 6 months or those retested at an interval 
of one year or more. The accuracy score on the Kuhlmann proves to be 
a rather stable index of the individuara method of working, providing 
he is given teats properly ranged for his level of ability, but the speed score 
does have a positive correlation of .41 to .44 with changes in IQ. 

The achievement tests were used to find out whether those girls whoso 
achievement level was least retarded were among those who were able to 
raise their IQ’s on retest. As mentioned in the statement of results, the 
relationship of achievement to grade level is somewhat distorted by the 
fact that the upper ceiling of the test is grade ILO. For this reason more 
significance is attached to the critical ratios than would be warranted 
without this factor which depressed some scores at the upper end of the 
distribution. With both delinquents and non-delinquents the improved 
group showed less retardation in achievement than those whose IQ^s on 
retest stayed about the same. It appears that achievement level ia more 
significant in this respect than the level of the first IQ. 

The personality test which provided the richest amount of material 
regarding individual adjustment was the ‘ Minnesota Multiphasic Per- 
sonality Inventory. Although it discriminated well between delinquents 
and non-delinquents, it gave no significant differences in either main 
group between those cases wherein the IQ improved significantly and 
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those in which it did not. The same pattern ia borne out by the com- 
parisona of total scores on the Washburne Social Adjustment Inventory. 
Aa adjustment is measured by these tests, there ia no greater maladjust- 
ment in one group than in the other. 

The Terman-Mileg Test of Mosculinity-Feminity showed no signih- 
cant differences between any groups, and the Vineland Social Maturity 
Scale revealed no differences in social age between those whose IQ im- 
proved and those whose IQ remained constant. The Pressey Interest- 
Attitude Test behaved atypically from the other tests in showing some 
difference between constant and improved delinquents and none between 
constant and improved non-delinquents. Moreover, it did not discrim- 
inate between delinquents and non-delinquents. Hence, four out of five 
personality tests showed no evidence whatsoever that there were marked 
differences in personality adjustment at the time of the first test between 
those whose IQ showed subsequent improvement and those whose IQ 
remained constant. The fifth teat, the Pressey, shows such conflicting 
results that no conclusion may be based on it. 

In general the results of the personality tests give a negative answer 
to the question of whether improvement in the adjustment pattern of the 
individual is related to improvement in IQ, although there is a alight 
tendency for the scores of the improved delinquents to move more toward 
the normal end of the distribution of scores than do the scoreg of the 
constant delinquents. With the non-delinquents, whofse personality teat 
Bcores were very normal on the flj’st te^t, the differences in amount of 
score changes are not so large nor are they always in the same direction, 
which suggests that they are chance fluctuations. The differences with 
the delinquents are not great enough to be statistically reliable nor to lend 
real weight to the hypothesis that improvement in general adjustment 
results in improvement of mental teat performance. 

Aa a further attempt to find out whether changes in IQ are related 
to changes in other factors which are indicative of the level at which the 
individual is functioning, in other words hia total personality adjustment, 
a record waa made of certain other items concerning the period between 
tests. Studies of IQ changes frequently mention physical health as a 
significant factor. The health record of the delinquents does not show a 
reliable difference between the groups, but the critical ratio is high enough 
to support the belief that physical condition may be a factor with bearing 
on efficiency of test performance. The present results lend support to the 
opinion of many psychologists that a test given at a time when an indi- 
vidual is not physically up to par should be repeated at a more favorable 
time. No one can judge with accuracy just which physical ailments 
affect mental performance and which do not. 
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Eeturning to the questions posed at the beginning of the study, we 
shall sum up the results within that framework. The only differences of 
personality and experiential background between those adolescent girls 
whose IQ^s show significant improvement and those whose IQ’s remain 
relatively constant are that those who do. not improve so much on the 
second test tend to have more retardation in level of school achievement 
than the variable group, and they tend to come from homes in which the 
parents have a lower level of education and occupation. Of the changes 
occurring between tests, there were no significant changes in the improved 
group 03 compared with the constant IQ group of the non-delinquents. 
In the delinquent group those who showed the greatest improvement in 
IQ were the group who had a poorer health record, so presumably it con- 
tained more girls who were not in good pliysical condition at the time of 
the first test. 

This lack of proof for the significance of emotional factors in the test 
situation, at least for adolescent girls, carries some implications for the 
clinician. In recent years whenever a clinical psychologist cannot find 
any evident reason why an IQ changed significantly, it has become the 
custom to fall back on the idea that the individual may be better adjusted 
at the time of the second test, a statement rarely backed up by any data. 
Although there is a possibility that in some cases this is true, it is by no 
means a common or easily demonstrated cause for shifts in IQ at the 
adolescent or adult level. The problem in young children may be quite 
different and also with older adults, who often are tested at the time of a 
court trial or some other emotional strain. The latter situation is some- 
what similar to the situation of these delinquents when given their first 
test, but one is not privileged to generalize these conclusiona beyond the 
adolescent group. The great emphasis put on emotional factors by psy- 
chologists, psychiatrists, and social workers has made all persons dealing 
with maladjusted individuals particularly conscious of them, and the 
present study in no ^Yay minimizes their importance to the individual or as 
a determiner of behavior, but only minimizes their effect upon mental test 
performance. 

Summary and Conclusions 

Two groups of adolescent girls, 101 delinquents newly admitted to a 
State School for Girls and 85 public school girls, whose ages ranged from 
12 to 19 and whose median grade placement was 9Lli grade, were given an 
individual intelligence test, an achievement test, and a battery of per- 
sonality tests. They were retested from 4 to 15 months later. Delin- 
quents and uon-delinquenta were divided into subgroups composed of 
those whose IQ^s on retest changed 10 points or less, called the constant 
groups, and those whose IQ’s improved more than 10 points, called the 



Personaliif/ Patterns of Adolescent Girls: I 


227 


improved groups. Differences of personality adjustment were measured 
by computing significance of difference of the mean scores for each group 
on the personality tests and by classifying and measuring the significance 
of difference of other items, such as occupation and education of parents, 
racial and national background, language in the home, ^Yo^k experience, 
length of time out of school, type of delinquency, other known social 
problems in the family, and home ratings. In the interval between tests 
school grades and health records were compared, and — in the delinquent 
groups — discipline records, and work and behavior ratings. Differences 
were computed between the mean amount of change in scores on per- 
sonality tests given in the second examination. 

The following conclusions appear to be warranted: 

1. The non-delinquents showed ns large shifts in IQ on retest as the 
delinquents. 

2. In both delinquent and non-delinquent groups those who showed 
less improvement in IQ on retest showed the greater amount of achieve- 
ment retardation. 

3. There were no significant differences in the degree of adjustment at 
the time of the first test or in the experiential background between those 
who improved on retest and those whose IQ remained relatively constant. 

4. There were no significant differences between the constant and 
improved IQ groups in relation to the personal-social history which took 
place in the interval between tests. 

5. There were no significant differences of personality adjustment 
between the constant and improved IQ groups afc the time of the second 
test. 

6. Concomitant personality factors, as measured by these tests and the 
criteria set up by this study, do not have any demonstrable effect on the 
changes in mental test performance between test and retest of adolescent 
girls. 

Recmed /unc 12 ^ 1944^ 
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Studies in the Symbolism of Voice and Action: V. The Use of 
Behavioral and Tonal Symbols as Tests of Speahiug 
Achievement 

Fiaaklin H. Knower 

Unitieriily «/ Iowa 

There are two general lines of procedure which may be followed in 
initiating a program of research in test construction, First, one may begin 
with a large number of items selected because of some presumed diagnostic 
value in the test, and then, through o program of item analysis, select and 
retain those items which contribute most to tlie value of tlie test. In 
following the second method, one begins with a limited number of items, 
retains those found to be useful and then adds to them as the evidence 
indicates a need for additional items to improve the value of the test. 
The firs,t method may be said to be most satisfactory in dealing with testa 
of a nature comparable to those of already known value. The second 
method is to be preferred in the development of tests which are essentially 
different from those of established patterns, for unless a test of a limited 
number of items can be shown to have some usefulness, the possibility 
thot a test of a greater number of items will be of value is immediately 
open to question. 

The second method just described has been employed in the work on 
the tests used in this project. The data to be presented are to be inter- 
preted, therefore, fls preliminary findings. 

The use of tonal and behavioral symbols as a supplement to linguistic 
means of communication long have been considered by critics as signifir 
cant factors in the process of speaking. A number of recent studies have 
supported this impression. 

Monroe ‘ found that two of the more important elements in the second 
factor revealed by his factor analysis of the characteristics of good speech 
were "Used good gestures" and “Voice not monotonous." Barnes ^ re- 
ports "Monotonous voices" and “Poor bodily control" as relatively high 
frequency faults among the speech students he studied. In a study by 

‘ Monroe, Alan H. The measureniQnt and analysia of audience reaction to student 
speakcra, Sliidiea in Higher Educalion, Purdue Univerflity, xxsii, 1937. 

“ Barnes, Horry G. A study of tlio speech needs and abilities of students in a first 
course in epaech training at the college level. Unpublished Doctoral Dissertation, State 
University of Iowa, 1932. 
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Gilkinson and Knower > '^Monotonous voices,” ''Inanimate bodies” and 
"Little facial expression" were not only indicated as high frequency faults, 
but 'were also shown to be speech characteristics clearly differentiating 
speakers of superior from inferior quality* At one point in their report 
on the Michigan Cooperative Study, Hayworth and colleagues ^ have 
indicated that the number of "Meaningful facial expressions per minute” 
was found to be a factor of relatively high weight in the determination of 
"Total effectiveness of speech delivery.” At another point in their report 
on the evaluation of specific testa of "Vocal interpretative ability,” 
"Pantomiming ability,” and "Facial expression,” their data indicate 
moderate to marked xeiationship with "Public speaking effectiveness” for 
the first two tests; and approximately a zero correlation for the teat of 
"Facial expression.” The absence of an indication of relationship in the 
second test may be attributed to the inadequacy of tlio particular test 
used. 

With the exception of part of the data in the Hayworth study, all of 
the data obtained on this problem in previous studies have been secured 
by the processes of rating a speaker on his use of these symbolic processes 
during the activity of speaking. The data in this study, on the contrary, 
arc not derived from an evaluative judgment on the quality of the per- 
formance, but as explained later are actual interpretations of meaning. 
This investigation was undertaken to secure data which might throw light 
on the answers to the following questions. 

1. Is it possible to develop reliable and valid objective group teats of a 
speaker's skill in the use of tonal and behavioral symbolism as such? 

3. What can we learn from such objective tests about the relationships 
of such skills to the total effectiveness of the speaker in speaking, and to 
other characteristics of the speaker as a person? 

The tests upon which this study are based are adaptations to group 
tesbiDg purposes of the measuring instruments used in the study of tonal 
and visible symbolism reported in the Quarterly Journal of Speech by 
Dusenbury and Kno'wer,^ The test form consists of a sheet of paper 
containing in the left hand margin a list of eleven emotional states each 
designated by three terms selected to facilitate the recognition of the 
particular qualitative or quantitative differences in the emotional states 
to be expressed. A series of columns across the sheet are arranged to 
permit judges to record their interpretations of each performer's stiinula- 

^ Gilkinson, Howard, and Knower, !FrankUn IL Psychological studies of individual 
diilerencGS among students of speech. Univ. of Minnesota, Department of Specchj 1930. 

* Hayworth, Donald, A research into the teaching of public speaking. National Asso- 
ciation of T&aohors of Speech, Detroit, 1940, Pp. 231. 

^ Dusenbury, Delwin, and Knower, Franklin H. Experimental studies of the ayni' 
bolism of action and voice. Quart. J. Speech, 1938, 24, 424r-436; 1039, 25, 67-74, 
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tioB in GQ-ch pcrfomaiice. As each student is tested his name is placed 
at tli6 head of a coluinn and recorders^ interpretations ai'Q placed below it. 
The recorder's name and other data are provided at the top of the judging 
sheet. 

Directions bo the performerfl for tho test of behavioral aymbolism were as 
follows: ''At the next meeting of the class you will be called upon to indicate 
the way you would express the eleven emotional states indicated on thia sheet 
by facial gestures or panfconiimo. Although you are expected to depend pri- 
marily upon facial expression you may allow your body to adapt to the expres- 
sion you are trying to indicate in the face. You are requested especially to 
avoid hand gestures of conventional meanings. You are to use your articulators 
as if you were saying the letters of the alphabet from ‘a* to bub you are not 
to form words with your lips which might be interpreted by lip readers. You 
are asked simply to express the emotions indicated as you would simulate them 
if you were portraying the emotions of a character in a story you were telling 
or in a play you were acting. During the class period I will call you to the desk 
on the platform one by one and hand you a scries of cards one at a time on which 
have been typed the terms for the eleven emotional states to be expressed. As 
I hand out each card I will call out numbers from '1' to 'll' and record these 
numbers on a key slieet for correcting the responses of the observers. The 
stimulus cards will be shuffled after each performance to vary the order for the 
next performance. You are expected to take only two to three minutes for 
the entire eerica of eleven expressions and you must therefore respond as quickly 
to the cue cards as you would to the cue lines in a play." 

Tile directions for the members of the class, who served as judges when not 
performing, wore as follows: "You are to place each performer's name at the 
top of the column in which you record the judgments of his performance. As 
I call each number observe the speaker carefully, look quickly down the list 
of eleven emotional states and record the number in the proper column oppoaito 
that emotional state which in your judgment the speaker is simulating. You 
are to record a judgment for each number, and record each number opposite 
only one set of terms. After the first expression for each performer, if you 
interpret a later expression as the simulation of an emotion for which you al- 
ready have one judgment, you may place the second number also opposite bho 
terms for that emotion. For every set of terms on which yon record more than 
one judgment, you will leave one set of terms without a number. You should 
familiarize yourselves with the list in order to record your judgments rapidly," 

The directions for performance in the tonal teat differed from those for the 
visible symbolism only in the following manner. "At the next meeting of 
the class I will call each of you to the back of the room and ask you to 
simulate a tonal expression of each of the emotional states indicated on this 
sheet. You are to use no words but in giving tonal body and pattern to the 
expression you are to articulate the letters of the alphabet, from 'a' to 'k.' " 

The process of judging the tonal expre-ssions differed from the process 
of judging the facial expressions only in that the judges listened to the 
tonal expre.ssions rather than observed tlie behavior of the speakers. As 
has been indicated, the instructor in the class made a key during each 
performance for the purpose of checking the correctness of interpretations, 
Since in no case were there fewer than sixteen persons in the class section 
tested, there were at least fifteen judges for each performance. 

The tests were scored in two ways. First the number of correct judg- 
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ments for each, performer were divided by the total number of judgmenta 
when checked against the key to provide a score in terms of a percentage 
of audience comprehension of each performance. Secondly, the niiinber 
of correct judgments rendered by each judge was divided by the total 
number of his judgments to provide a score in terms of the percentage of 
Ma comprehension of the performances of all other members of the class. 
Although the class average for the performances and judgments were of 
course always the same, marked differences in individual ability of both 
types occurred within most classes, 

Before analyzing the data from the study, it may be well to consider 
some of the advantages and limitations of tests of this type. On the 
question of their desirable features, I wish to call attention first to the fact 
that these teats are actual teats of the social dynamics of speech. The 
score in no way depends upon an auditor's interpretative judgment of the 
excellence o£ the performance, but only on the specific percentage of the 
speaker’s intelligibility. Since the testa are of this type they moy be used 
to analyze individual differences in the nature of the behavior of both 
speakers and auditors. A relatively large number of persons can be 
tested in the average class period in a situation which approaches normal 
student speaker-auditor relationships. The fact that the teat may func- 
tion os a learning activity commends it aa a classroom exercise apart from 
its test features. 

Such tests may be criticized as abstractions in that they isolate tonal 
and behavioral symbolism from their normal accompaniment in speech of 
linguistic expression of ideas. While this ciiticism is obviously sound, it 
is probably not more true for the test in question than for typical tests of 
articulatory or linguistic skill. Although intelligent persons do not ordi- 
narily go about engaging in unprovoked facial activity or vocal noises, 
neither do any but school teachers and other intellectually curious persona 
go about randomly articulating phonemes, declining adjectives or parsing 
sentences. These characteristics of tests probably are necessary limita- 
tions of the problem at hand. Although the tests may not provide an 
adequate index of refinement in the use of non-linguistic symbolism for 
advanced students, the limitation of scores to intelligibiUty provides a 
sufficient top for moat students with limited speech skills. A third ques- 
tion may be raised concerning a test of a speaker's performance which 
limits the index of hia skill to the comprehension ability of his audience. 
This might be a serious limitation were it not for the fact that in almost 
every class tested the range of scores on performance has been moderately 
high. Data will be presented which indicates that in a class of at least 
fourteen judges the reliability of the tests is sufficiently high for purposes 
of group analysis. 



Studies in Symholisin of Voice and Action: V 


233 


The major data on the project are presented ia Table 1 . The correla- 
tion of the performance scorea of subjects aa interpreted by seven judges 
with acorea aa interpreted by seven additional judges produces what may 
be called a split-half index of the reliability with which performances are 
judged. When corrected for the split-half technique, the reliability cor- 
relations for scores on behavioral symbolism were +,93 and for tonal 
symbolism +.87. The individual performances, then, were reliably in- 


Table 1 

Reliability and Validity Correia tiona 



Behavioral Symbols 

Tonal Symbols 


PerPnee 

Judg^nt 

Perf'ncQ 

Judg'nt 

Seven with Seven Judges 





(Corrected) 

.93 dh .01 


.87 ± .02 


Test-Retefit 

Speech Etgs. for General 

.52 ± .05 

.09 ±.03 

.66 ± .03 

.92 ± ,01 

Effect^nesB 

,47 ± .04 

.66 ± .04 

.26 ± .06 

.66 :b .04 

Speech Rtge. for Adjustment 

.42 =k .06 

.40 ± .06 

.34 ± .05 

.41 ± .06 

Speech Rtga. on Phonation 
Performance with Judgment 



.31 ± .06 

.46 ± .04 

(lat Test) 

Porfoimanco with Judgment 


.67 ± .03 


.49 ± ,04 

(2nd Teat) 


.33 =b .00 


.66 ± .06 


terpreted. To determine whether or not the expreasional skill of the 
individual was consistently characteristic of hia performance, each teat 
was repeated after an interval of one week for 100 subjects. The second 
line of the table indicates these test-retest correlations, Although these 
correlations indicate a substantial amount of consistency in the traits 
measured, they also indicate that there was considerable variation in per- 
formance on the second test, with skill in the use of tonal symbolism 
varying less than skill in the use of behavioral symbolism. Since the 
indices or scores for each performer are based on the average accuracy of 
interpretation of fifteen listeners, — where fourteen judges produced re- 
liability of +.93, — these correlations cannot be attributed to the unre- 
liability of the particular scores. These teat-re test correlations were 
seriously affected by the average gain in the effectiveness of performance 
on the second test, and by the fact that the range of scores was consider- 
ably reduced on the second test. Since the average gain in effectiveness of 
the use of tonal symbolism was as high as the average gain in effectiveness 
o( the use of behavioral aymboliam the higher test-retest correlations for 
the teat of tonal symbolism indicate that fewer subjects approximated the 
top of the tonal teat than the behavioral teat. This assumption is sup- 
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ported by the fact tlmt the mean level of performance in the use of tonal 
symbols was considerably lower than the mean level of the skills in be- 
havioral symbolism. 

The correlation indices of validity may be best described as moderate 
to marked in comparison with other tests of this type. These data are 
inconsistent with those reported by Hayworth in tlmt tin's test of per- 
formance in the use of facial expression appears to be more closely related 
to speech skill than does the test of the use of tonal syiTibolism. An 
interesting feature of these correlations is found in the fact tliai ratings on 
performance are more closely correlated with slcill in judgments of per- 
formance than with skill in performance Hsolf. If this phenomenon 
should be found to be consistently true of this typo of test, and if these 
validity correlations may be improved by the development of the tests, it 
will mean that smee judgment scores may be obtained more conveniently 
than performance scores, the potential usefulness of the tesla will be 
greatly improved. 

Table 2 

Means and Standard Deviations of Ihe Distributions 



First Performance 

Second Pcrfonnanco 

Mcaiia 

S.D, of 
Pcff. 

S.D. of 
Jiidg, 

Means 

S.D.of 

Perf. 

S.D. of 
Juclg. 

Behavioral Syinbolfl: 







UreabinGn (Required) 

62.70 

10.10 

14,10 

71.10 

13.10 

10.50 

Sophomorea (Elective) 

70.00 

10.85 





Tonal Symbols; 







Eieahinen (Required) 

45.10 

13.70 

0.15 

67.40 

13.50 

10.90 

Sopliomores (Elective) 

CG.80 

13.95 





Acting Ckaa 

83.30 

4.95 






Table 2 contains some additional data on validity in the form of means 
and standard deviations of distributions of scores for various groups. A 
group of 50 sophomores in an elective course in speech were compared 
with 100 freshmen in a required course and found to be eight per cent more 
intelligible in the use of visible symbolism and twenty-one per cent intelli- 
gible in the use of tonal symbolism than were the freshmen. The differ- 
ence between the two groups is highly significant in the use of tonal 
symbolism and probably reliable in the use of visible symbolism. Nine- 
teen students in an advanced class in acting received scores on the tonal 
test that were significantly higher than the scores received by the 
sophomores. 

The standard deviation of the judgment scores of the freshmen on the 
first tests are here seen to be considerably higher than their deviation on 
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the second tests. I’lie amount of improvement on the second tests is also 
indicated here in terms of higher mean scores on the second tests. I 
should like to point out that, although these mean scores are considerably 
lower than those reported by Dusonbuiy and Knower's advanced per' 
foimors, they are still high enough to indicate that a higldy significant 
amount of communicatio/i may toko place through the use of tonal and 
behavioral symbolism by the average college student, 

In concluding, I wish to comment on the last two lines of corrclationa 
in Table 1. In spite of apparent differences in skill in performance and 
judgment those correlations indicate a considerable relationship between 
tliese two traits. The relationship appears to be more constant in the 
area of tonal symbolism than in the area of visible symbolism. These 
data support the suggestion previously advanced that a group test of skill 
in the judgment of tonal and behavioral symbolism might be developed 
which will provide a useful test of skill in performance. Such tests are 
useful na classroom checks on the development of significant aspects of 
speech achievement. 

Received May 1044^ 



Participatioa in High-School Football as a Factor Affecting 
College Attendance and Scholarship 

Erwin J. Henning and Harold D. Carter * 

School 0/ EdueaHm, UTOcersilv 0/ Coti/omia 

Does participation in high-aohool football exert a significant influence 
upon the educational plans and later educational careera of high-school 
atudenta? If ao, what are the cficcts of such participation, and how do 
they operate? These queationa, which have long been subjects for heated 
discussion aa well aa for organized inquiry, are approached again here, 
with a variation m technique that appears to be new to this field of 
investigation. 

In order to develop a standard for estimating the effect of playing 
football on the educational careers of the players, a control group was also 
studied. Each high-school football player was matched with a classmate 
who did not play football. The college attendance and achievement of 
the control group were used as norma for comparison with the performance 
of the athletes. 

Records were taken for 2,875 pupils, including 220 football athletes, 
graduating from four large high schools in the years 1935--1937 inclusive- 
These high schools were all situated in the urban area on the eastern side of 
San Eranciaco Bay. The 220 football players were matched with 220 
of their classmates on the basis of six criteria, namely: (1) school; (2) date 
of graduation; (3) high-school scholarship; (4) average measured intelli- 
gence; (B) reading quotients aa measured by standardized tests; and (6) 
college preparatory study load, as measured by the number of units 
earned in courses which satisfy prescribed college entrance requirements. 
In the pages which follow, a detailed report is made concerning the high- 
school work and the college attendance and scholarahip of the two 
groups. 

Significant Earlier Studies 

The controversy over college reomiting and subsidizing of atliletos, 
which was at its height in the late 1920'e, precipitated the famous Carnegie 
investigation reported in 1929 in the bulletin on American College 
Athletlca (4) . In that wflcateh the ease study technique was emphasized , 

* The writeis ate indebted te Dr. Robert Gordon Spronl, Frcaident of the Univeraity 
of California, for bia encouragement, and for financial naaiatnnea which made the study 
possible. 
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Investigatora traveled from college to college studying conditions pertain- 
ing to the treatment of athletes, and reporting their findings. An accom- 
panying survey of the literature resulted in a separate publication leported 
in the 24 th bulletin of the society (5). This is an authoritatively com- 
prehensive sui'vey of the literature on athletics up to 1929. By 1933, the 
Carnegie Foundation had spent 1125,000 on its inveetigationa of athletics. 

The Carnegie research found previous studies on the relation between 
scholarship and athletics ill-controlled and inconclusive. Lack of uniform 
definitions made it impossible to compare results in the various schools. 
For this reason, Howard Savage, who directed the Carnegie investigation, 
sponsored a study of scholarship and athletics at Columbia University. 
This study served as a model for coordinated projects in 52 colleges (15). 
Nearly all later research on the scholarship of athletes in college has also 
followed Savnge^a model. The various investigations demonstrate that 
the athlete tends to be slightly inferior to the non-athlete in measured 
intelligence and in grades earned, but not enough ao as to interfere seri- 
ously with his scholastic work. Athletes take a normal study load and a 
normal variety of college courses, and have slightly smaller academic 
mortality than non-athletes; however, more athletes than non-athletea 
receive grades near the failing mark, and more are on probation. These 
studies show a difference among sports, with sports for individuals, such 
as tennis, golf, track, etc., ranking high when judged by the academic 
achievement of participants, whereas team, spectator sports such as 
baseball and football rank low when judged by the same criteria. Later 
college investigations such os those by Tuttle (18), Hackensmith and 
Meller (10), Maney (12), and others tend to confirm the findings reported 
in the Carnegie Foundation studies. 

In the field of high-school athletics, Reals and Rees (14), Mathews 
(13), Hull (11), and Allen (1) find athletes slightly inferior to their non- 
athletic fellows. In no case is the reported difference large. Cormany 
(7), Cook (C),' Beu (2), Schuhnan (16), and Shannon (17) report high- 
school athletes equal or slightly superior to their classmates. Several of 
these reports show that while athletes tend to be inferior to their fellow 
students who are active in other extra-curricular activities, they tend to 
be superior to those who have no extju-curricular interests. Davis and 
Cooper (8) reviewed 41 studies in this field, and concluded that probably 
the non-athletes are slightly superior to the athletes, but that the differ- 
ence is not significant cither statistically or educationally. 

The above are but a sampling of the reports on athletes in high school 
and in college. Very few studies have followed high-school athletes into 
college. To do so seems desirable, since the controversy rages over the 
inducing of high school athletes into college by promises of glory, financial 
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rewards, or lowering ot academic BtandardK. Buck (3) studying 1093 
high-school boys in Colorado, found that 21.8 per cent of tlie athletes 
planned to go to college, whereas only 11.6 per cent ot the non-athletes 
planned to do so. He gave no data as to tlic relative college qualifications 
of the two groups. Among the athletes, the athletic prestige of tlie col- 
lege stood first in determining a specific choice, whereas this was last in 
the list for non-athletes. Relatively more athletes than aon-athictes 
persisted in college until they received a degree. Here again, only meager 
data are presented as to the relative qualifications of the two groups. 

The present study is unique in that it begins with high-school groups 
of equivalent academic qualificatiouB, and follows them into college. 

High-School Records 

A by-product of matching football athletes with controls was the 
accumulation of b large mass of data regarding the higli-school lucords of 
all athletes a-nd non-athletes. These data are entirely in agreement with 
the literature on the scholarship and ability of high-scliool athletes. 
Table 1 presents the results. They show the non-athlctea to be slightly 
though consistently superior to the football players. 

These data have more value than merely substantiating the extensive 
literature in the field. By falling completely in agreement wi bh numerous 
other investigations, they demonatrate the typicalncss of the high-school 
sample used here, and hence indicate the validity of our further findings. 
They encourage one to generalize with confidence beyond the four specific 
high-school populations studied, 

The above-mentioned data are for total populations, showing that 
the football athletes closely resemble the rest of the student body. Tor 
the matched pahs, however, the reaembltince is still closer os a result of 
the process of matching. The median difference between the football 
players and their controls in grade point ratio, intelligence quotients, 
reading quotients, and type of high-school load is only .19 times os large 
as its standard error, demonstrating the practical identity of the qualifica- 
tions of the matched groups. This identity is necessary to satisfy the 
basic premise of this study. If athletes and their controls are substan- 
tially identical in the qualifications which ordinarily determine college 
entrance and success, then the average college experiences of the two 
groups should also be identical within statistical limits of clianee vaxiation, 
provided that playing football in high-school has no influence in college. 
Conversely, any real variation between the experiences of the two groups 
is attributed to the football qualifications of the experimental group. 
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Table 1 


High School Record of Football Athletes Compared with That of Varioua Other Groups 



N 

Mean 

Comparing 

Lines 

Diff. 

LifF. 

S.E.Dirr. 

Grade Point Ratio: 






1. All football players 

220 

247 




2. All others 

2655 

2,54 

1&2 

.07 

1.82 

3. Matched control group 

220 

247 

1 & 3 

,00 

.00 

4. Athlofcag attending college 

133 

2.02 




6. Controh attending college 

99 

2,76 

4& 6 

.14 

2.10 

Intelligence Quotients: 






1. All football players 

220 

106.44 




2. All others 

2655 

107.94 

1&2 

1.50 

1.72 

3. Matched control group 

220 

106.80 

1 & 3 

.36 

.32 

4. Athletes attending college 

133 

110.31 




5, Controh attending college 

99 

112.71 

A&- 5 

2.40 

1.92 

Reading Quotients: 






1. All football players 

220 

107.10 




2. All others 

2655 

110.58 

1 & 2 

3.48 

3.07 

3. Matched control group 

220 

108.84 

1 &-3 

1,64 

1.05 

4. Athlete.’] attending college 

133 

110.42 




5. Controls attending college 

99 

113.90 

4<& 5 

3.48 

2.06 

^lumber of Half-Uni ts College 






Preparatory Coureea: 






1. All football pJayera 

220 

25.98 




2. All others 

2665 

25.30 

1 & 2 

.67 

1.69 

3. Matched control group 

220 

26.57 

1 & 3 

.40 

.79 

4. Athletes attending college 

133 

27.95 




6. Controls attending college 

00 

28.13 

4 &5 

.17 

.29 


Plans to Attend College 

More football athletes than controls planned to go to college, aa indi- 
cated by transcripts sent. Table 2 shows that 28.2 per cent more atliletes 
than controls sent transcripts to college. This difference is 7.52 times 
its standard error, and hence is statistically significant. The University 
of California received more enquiries from athletes than from controls, but 
the difference is not significant. All colleges receiving fewer than three 
enquiries from prospective students in this group wore classified as ^^mis- 
cellaneous’ ^ colleges. In the aggregate, these miscellaneous colleges re- 
ceived 47 enquiries from football students and 37 from controls. TJie 
difference is not significant. Besides the University of California and 
the miscellaneous colleges, thirteen other colleges received transcripts 
from prospective students. Of these, the seven receiving the majority 
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of the transcripts were all local institutions which ciuphasizc football, 
This is the group of colleges which received significantly more transcripts 
from football athletes than from members of the control group. 


Table 2 

Planned and Actual Ccllcge Attendance of Members of Miitclied tlroups 



Football 

CoiUiol 



Uiff. 


Group 

Group 

DilT. 

s.r;,r> 


PlaiiiLed college attendance as indi> 






Gated by transcripts; 

Total number sending transcripts 

201 

139 




% of 220 sending transcripts 

91.4 

63.2 

28,2 

3.75 

7.52 

Number planning to go to U.C, 

77 

66 




% or 220 planning to go to U.C. 
Number planning to go to 13 

35.0 

30,0 

5.0 

•1.40 

1.12 

colleges 

% of 220 planning to go to 13 

78 

36 




colleges 

36.4 

16.4 

19,0 

-1.07 

4,67 

Actual college attendance of mem- 






bers of matched groups', 

Total number going to college 

133 

09 




% of 220 going to college 

60.5 

45.0 

15,6 

4.B9 

3.30 

Number going to U.C. 

02 

.56 




% of 220 going to U.C, 

28.2 

25.5 

2,7 

4.21 

,01 

Number going to 13 colleges 

53 

24 




% of 220 going to 13 colleges 

24.1 

10.0 

13.2 

3.54 

3.73 


College Attendance and High-School Scholorship 

Table 2 summarizes facts from the college attendance records of mem- 
bers of the matclied groups. 2.8 per cent more athletes than controls 
attended the University of California; the difference is negligible. 13,3 
per cent more athletes than controls attended the thirteen colleges; this 
difference is significant. Eighteen football athletes and nineteen controls 
attended miscellaneous colleges. Thus a total of 133 athletes attended 
college, compared with 99 members of the control group. The difference 
is 3.09 times as large as its standard error. The excess college attendance 
of athletes over controls is due almost entirely to the fact that the thirteen 
colleges accepted more athletes than members of the control group. TJie 
inference follows that the excess college attendance of the athletes is due 
to their high-school football eKpeiience, 

The data in Table 1 permit comparison of the qualifications of the 
athletes who attended college with the qualifications of the controls who 
did so. The athletes tend to be inferior to the controls, Which colleges 
accepted these inferior students? The qualifications of the members of 
the matched groups who attended the miscellaneous colleges are nearly 
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equivalent. The data for memberfl of the matched groups attending the 
thirteen colleges and the Univeraity of California are compared in Table 3. 
At the Univeraity of California the high-school football students who 
entered college came with generally better qualificationa than those of 
their controls. At the thirteen colleges the reverse was true. Table 3 

Table 3 


CaiiiiJamon of llig;h-Scho<}l QualiCtc&tiaiia of Faotbaii Athietee and Control Qroupg 
Attending the University of California and the 13 Colleges 



Football Groups 

Control Groups 

U.C. 

13 Colleges 

U.C, 

13 Colleges 

Number attending 

62 

63 

56 

24 

Mean high-scfiocf grflde-pointrafcio 

2.90 

2.38 

2,80 

2.58 

Dificrence between mcana 

.62 


,31 


Standard error of difference 

.08 


.13 


Critical ratio 

6.23 


2.37 


Mean high-Bchool IQ 

114.07 

107.00 

113.43 

110.33 

Difference between raean« 

7.07 


3,10 


Standard error cf difference 

1.74 


2.29 


Critical ratio 

4.00 


1.35 


Mean high-echool reading quotient 

112,10 

108.98 

1113.11 

113.01 

Difference between meane 

3.12 


.10 


Standard error of difference 

2.10 


2.82 


Critical ratio 

1.27 


.04 


Mean number half-units college 





preparatory courses 

29.71 

20.25 

28.82 

27.38 

Difference between means 

3.16 


1.44 


Standard error of difference 

.93 


.60 


Critical ratio 

3.72 


2.40 



emphasizes this situation by comparing the football students who at- 
tended the Univeraity of California with the football students who at- 
tended the thirteen colleges. A similar comparison is made for members 
of the control group who attended these schools. 

In all cases the high-school qualifications of students attending the 
University of California were superior to the average qualifications of 
those ^Yho attended the thirteen colleges. This is true both for athletes 
and for controls. The Univeraity of California attracts the better stu- 
dents from this area . However, the diff erencea between the qualifications 
of the controls who attended the University of California and the thirteen 
colleges were relatively small and statistically non-significant. The criti- 
cal ratios are displayed in Table 3. Thus while the state university 
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attracted generally better-qualified students than the thirtcon colleges j 
the differences \vere small for ordinal^ students. The seven local colleges 
emphasizing football, however, attracted and accepted football studentB 
who were definitely inferior in academic ability and acliievement, Since 
this is not true for non-football studcntSp the results auggeat a lowering of 
standards by these local colleges, for prospective football players. The 
same results indicate that at the University of California standards were 
rot lowered for football players. 


Table 4 

Average Grade-Points RatioB Ettvned in College by Members nf Matched Groups 



V 

Mean 

Did. 

S.E.,> 

Dirt. 

Uiiiveraifcy of Cnlifornia 






Football Group 

62 

1.272 




Control Group 

56 

1.141 

.131 

.081 

1.62 

Thirteen Colleges 






Football Group 

53 

0.782 




Control Group 

24 

1.105 

.323 

.187 

1.73 

Totals 






Football Group 

115 

I.O'IO 




Control Group 

80 

1.133 

.087 

.086 

1,01 


Table 4 shows that at the University of California the football 
athletea earned slightly higher grades than members of the control group 
The difference is so small, however, as to be insignificant. On the other 
hand, tJic grades received by football players in the thirteen colleges were 
inferior to those of their controls . These results arc exactly in agreement 
with the high-school qualifications of the groups concerned. Thus while 
the thirteen colleges accepted football players with inferior qualifications^ 
the grades given them were not out of line with their abilities. Appar- 
ently the influence which gets these inferior students into college does not 
extend to the clagaroom teachers who assign them grades. 

Other Comparisons 

A number of additional comparisons are furnished in Table 5. Of 
the football players entering college, 45,1 per cent were eventually gradu- 
ated, as compared with 42.4 per cent of the controls. TJius, in spite of 
inferior entering qualilicationSj the athletes were graduated at least as 
frequently as were the controls. 

The types of college courses pursued by athletes and controls were 
equally dlstvibuted. While the athletes took fewer technical and com- 
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Table 5 


MiscellaiiGoiis Data Concerning Mcmbora of Matched Groups Who Attended College 



TootbaH Group 

Control Group 

N 

% 

N 

% 

UniverfiiLy of Califcrnia: 





Number who fttlcmled 

G2 


6S 


Average no. of semesters 

7.6 


7.0 


Number graduating 

36 

68 

33 

59 

Semcatera on probation 

53 

11.3 

33 

8.4 

Number dismiasoJ 

10 

16.1 

7 

12.5 

Thirteen Colleges: 





Number who attended 

63 


24 


Average no. of semestera 

4.3 


4.0 


Number graduating 

10 

26.8 

7 

20.2 

Semesters on probation 

25 

10.9 

13 

13.5 

Number diBmiaseJ 

7 

13,2 

1 

4.2 

MiscellaueoiiB CoUegca: 





Number who attended 

18 


19 


Average no. of Bemesters 

4.3 


3.7 


Number graduating 

5 

37.8 

2 

10.5 

Total Group: 





Number in college 

133 


99 


Average no. of sem esters 

5.8 


6.6 


Number graduating 

60 

46.1 

42 

42.4 

Semesters on probation 

78 

11.2 

4G 

0.4 

Number diRmissed 

17 

14.7 

8 

10.0 


mercial courses than the controls, they took about the aame number of 
professional coumes, arts 00111*808, and vocational courses. The distribu- 
tion is normal enough to refute the argument that athletes take only easy 
courses in college. 

As to the relative numbers of the two groups who were on probation, 
numbers of honors received, and numbers of semesters in attendance, the 
data tend rather consistently to favor the control group, but by very 
small margins. 


Star Athletes 

From the group of 220 athletes, the sixty most outstanding football 
players were selected, Tliese were compared with the other athletes^ with 
the controls, and with the general population. No data, either in high- 
school or in college, yielded sufficiently large differences to permit one to 
conclude that the sixty star athletes enjoyed an experience in any way 
artypical for the whole football group. 
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Summary and Concluaions 

A study has been made eomparing the college attendance and echolor- 
ship of 220 high'Scliool football athletes with similar data for 220 of their 
classmates who did not play football. The two groups ^Ye^o carefully 
matched for intelligence and higli-achool scholarship. The data lead to 
the following conelusioiiB’. 

1. In comparison with other students of equivalent academic qualifica- 
tions, football athletes more often plan to go to college, 

2. A greater proportion of football athletes actually do go to college. 

3. A greater proportion of football athletes graduate from college, 

4. The football athletes have slightly inferior high-school records. 

5. The football athletes tend to enter certain colleges in which football 
is a prominent sport. It is inferred that standards of admission in these 
colleges are lowered for prospective football players. 

Received Mag 26, 19/fi. 
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Two Methods of Combming Attitudes of Like, Indifference and 
Dislike Into One Score 

Philip Eisenberg 

Colvmhia Broadcaaling System, Jnc., Nm Torfe Gily 

In radio research, as in many other fielda of inveatigntion, the social 
acientist frequently a&a his subjeota to express their like or dislike of a 
stimulus. Since it is undesirable to force the individual to express like or 
dislike when he is not sure of his opinioa or when he does not feel strongly 
either way, he is frequently permitted to express his doubt or indifference, 

Thus, the listeners’ judgments can be completely distributed among 
the three categories of like, indifference and dislike. For convenient 
comparisons of reactions to diBerent stimuli, it is desirable to express the 
three percentages in one combined score. Two such combined scores 
have been used. The problem of this investigation is to determine the 
relative merits of the two scores as applied to the attitudes of groups of 
listeners responding to various radio programs.' 

The Two Scores 

A. Th^ LD-scon. The eustoroary technique of combining the three 
reactions into one score is to assign relative weights to each reoction and 
sum the resultant produota. One way of doing this ia to subtract percent- 
age dislike from percentage like. Minus signs can be eliminated by 
assigning weights of 2 for like, 1 for indifference, and 0 for dislike. Either 
method yields the aame result, We will refer to this score os the Like- 
minus-Dislike score, or for convenience, as the LD-scoro. 

B. The S-score. Lazarsfeld and Robinson " have proposed another 
technique of combining the three reactions into one score, which ia essen- 
tially a sigma score, and can therefore be called an S-score. It ia based 
on three assumptions: 

‘ All data were obtained with the use of tho Lnzarsfold-Stanton program analyzer 
technique ns used by the Program Analysis Division of tho Columbia Broadcasting 
System. In this teclmique, the listener ia naked to express hia attitudea throughout a 
broEidCBst by pressing a green button when ho likes what ho is listening to, a red button 
when he dislikes it, and neither button when he is indillojent. The picasing of tho 
buttons is automatically recorded on a moving tape. For a moro detailed dcacription 
of the program analyzer, see the nrticle by T. Hnllouquiat and E. Bucliman in Radio Re- 
search i9iS-1943 edited by F. F. Lozarsfold and P. Stonton, pp. 266-334. 

• Lazarsfeld, P. F., ond Hobinaon, W. S. Some propertiea of the trichotomy “like, 
no opinion, dislike" and their payohological interpretation. 1940, 3, 151-178. 
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1. Reactions to a stimulus are quaniitaiive and in a continuous seHes, 
Three types of reaction are obtained because of the limitation of the in- 
sbructions given to tlie subject- But it is safe to assumer that diffareat 
degrees of feeling are expressed at different times Ayithin the same category 
of reaction. This ia borne out by the comments made \vhen the subjects 
talk about a program to which they have reacted. 

2. Reactions are normally distributed. Since intensity of reactions ia 
not measured, this assumption cannot be tested directly. However, the 
normal distribution remains a useful assumption, especially since it ia 
unlikely that the distribution of reactions to a radio program ever assumes 
the shape of a J-curve. 

3. A point of true neutrality' exists within the indifference range. This 
assumption ia really a speciflo aspect of the first two assumptions. Since 
it ia assumed that there ia a gradient of reactions ranging from extreme 
dielike to extreme like, there must be some point between these two ex- 
tremes of true indifference or neutrality, The most likely point of neu- 
trality seems to lie somewhere in the middle of the indifference range. 
Lazarflfeld and Robinson present some empirical evidence to support thi? 
aaauraption.* 

The S-score itself is the distance on the base line between the neutrality 
point (the middle of the indifference range) to the average of the distribu- 
tion, expressed in sigma units. The method of its computation is de- 
scribed in the previously cited article by Lazarsfeld and Robinson . 

There are two apparent advantages of the S-score over the LD-score: 
(1) Standard deviation units are definite atatistical terms with known 
meaning, whereas LD units are difficult to interpret. (2) Standard devi- 
ation units are equal, whereas LD units are not. 

The Method 

In order to study the relative merits of the S- and LD-scorea for entire 
programs, the percentages of like, indifference and dislike were obtained 
for 53 different radio programs, representing a variety of program types. 
The number of subjects listening to a program varied from 49 to 116, with 
an average of 67. 

The S- and LD-scorea were compared for the total ratings of the 53 
programs. They were also compared for program parts within three 
programs: one which was highly liked, one highly disliked, and one to 
which meat reactions were indiffei’ence. 

^ The assumption of n neutrality point is not necessurily required when it is noted that 
the S-score can also be viewed os the distance of dislike in sigma units subtracted from 
the distance of like in sigma units. This method of calculation will yield a score exactly 
twice the size of the S-acoro, 
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The 8- and LD-acores and the percentages of like, mdiUerence and 
diflUke for each of the three programa, and for the average of the 63 pio- 
grams, are presented in Table 1. 


Table 1 

Retvctionfl to Radio Programfl 


Radio 

Programs 

Scores 

PorcQntflgoa 


No. of 
Subjects 

S 

LD 

Like 

Jndif, Dislike 

Liked 

1.00 

.62 

00 

24 

7 

70 

Indifferent 

.60 

.28 

37 

64 

9 

110 

Disliked 

-.03 

.02 

25 

48 

27 

50 

Average of 63 

.08 

.40 

40 

43 

0 

3650 


It can be seen from this table that ^^liked/' disliked' ' and ^^indifferent" 
programs are relative terms, Generally more reactions tended toward 
like than toward dislike, which is not unexpected aitice the programs are 
designed fox entertainment. However, analyses of oral interviews of 
listeners to these programs confirm the deBignations obtained statistically. 

Results 

A, Relalion between the S- and LD-scorea. Table 2 present? correla- 
tions between the S- and LD-scores for total ratings in 63 programs and 
for ratings within three programs,^ 

Table 2 

Correlationa between S- and LR-Scores 


Gorrektione 


Total Scores of 53 Programs 

.97 ' 

Program. Parts 

Liked Program 

,03 

Indifferent Program 

.79 

Disliked Program 

.99 


With the exception of the indifferent program, it is apparent that the 
S-score and the LD-score are bo highly correlated with each other that the 
use of either score will result in approximately the same rankings of 
programs or of program parte. ' The high correlations further suggest that 
the data would be interpreted in much the same way whether the S- or the 
LD-acorea were used. 

* In all cases, correlationa for the total ratings of the 63 programs are Pearson product- 
moment, and for program parts are rank-difference. 
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Profile charts (not shown in this report) of and LD-acores for pro- 
gram parts within the three programs show graphically the high relation- 
ship between the two scores. However, it ia interesting that at the begin- 
ning and end of programs, and during applause and transition passages, 
where the percentage of like and dislike usually decreases, the LD-score 
tends to come closer to the base line than does the S-score. From this 
one may conclude that the LD-score reflects increased ^^indifference’* 
more readily than the S-score, 

S. Relotions heimem Ihe Two Scores and Percentage Ldke, Dislike and 
Indifference. Table 3 presents the correlations between the S- and LD- 


Table 3 

Correlationa between Two Soorea and Like, iDdifforence and Dislike 



Total Scores 


Program Paris 



63 

Programs 

Liked 

Program 

Indifferent 

Program 

Disliked 

Program 

S-L 

.87 

.86 

.42 

.68 

S-I 

-.62 

-.76 

-.09 

'.32 

S-D 

-.80 

-.27 

-.64 

-.80 

LD-L 

.90 

.07 

.89 

.74 

LD-I 

-.80 

-.01 

-.66 

-.37 

LDD 

Minim um 

-.69 

.01 

-.17 

-.70 

SigniflcBCt 

Correlation 

.38 

,30 

.42 

.45 


scores and the percentage of like (L), indifference (I) and dislike (D) for 
the total scores of 53 programs and for parts within three programs. 

From this table it is apparent that the S- and LD-scores correlate very 
much in the same way with the percentages of like, indifference and dis- 
like. However, the three reactions have a more equal weight in the 3- 
than in the LD-score. This seems to be^the case since the correlations for 
total scores and for program parts between the three reactions and the 
S-Bcores are more equal in size than for the LD-score. 

Another, significant difference between the two scores ia that the 
S-score seems to give greater weight to dislike than does the LD-score. 
The LD-flOore gives the greatest weight to like, the predominant reaction. 

C. The Reactions of ^‘Indifferent'* Subjects. A further comparison of 
the two combined scores can be obtained by examining the 'hndifference'' 
reactions. One approach to this problem was to examine the reactions 
of the most indifferent subjects in various programs. This analysis will 
yield some information concerning sustained indifference at least. Those 




250 


Philip Eisenberg 


subjects who pressed eitlier red or green buttons less than one-half of tlie 
program time were arbitrarily classified as “indifferent^^ subjecta. For 
eleven different programs, the indifferent group averaged 37 per cent of 
all subjects, 

The general attitude of the subjectsto a program was aacevtained by 
their answer to a standard question : 

fn order to get you to listen to future brondcasta in this series, should the 
programs be: very much like this one, improved a bit, or improved a good deal? 

Those who checked “very much like this one“ have been designated Satis- 
fied listeners; those who checked “improved a bib/* Conditional listeners; 
and those who checked “improved a good deal,” Dissatisfied listeners. 
This question has been found to correlate very highly with analyzer 
reactions and with the tenor of the comments made by listeners in group 
interviews after each prograna. 

In eleven different programs, it was found that 27 per cent of the 
Satisfied listeners, 40 per cent of the Conditional listeners, and 55 per cent 
of the Dissatisfied listeners were “indifferent,” This indicates that the 
“indifferent** listeners tend to be more dissatisfied with a radio program 
than the “non-irLdifferent” ligteneiSv 

One cannot conclude from these findings that “indifference** is always 
a negative reaction. “Indifference” may express an intermediate state 
between like and dislike. It may express anticipation or relaxation, ns at 
the beginning of a program or in transition passages. However, it is clear 
that some so-called “indifference** reactions are really negative, This 
seems to be true of much of the sustained indifference. The S-soore, 
therefore, seems to be superior to the LD-score, for radio programs at 
least, since it givbs more weight to dislike and in that way, scorns to take 
into account that port of indifference which is really negative. 

Summary and Conclusions 

The overwhelming conclusion from these data is that the S- and 
LD-scores yield virtually the same results and compel virtually the same 
interpretations of listeners' responses to radio programs. This conclusion 
supports the earlier investigation of Likert ^ in which he demonstrated 
that sigma scaling of attitude questions are no more reliable or discrimi- 
nating than a scoring of 1, 2, 3, 4 and 5 for the five alternate nnswerB. 
Despite this conclusion, there are certain other considerations which 
militate in favor of the S-acore: 

' Likert, K, A technique for thct measuremont of attitudes. Archives oj Psychology ^ 
1032, No. MO, 
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1. The S-score reflects all three reaclions more eguikbly than the LD- 
score. The LD-score gives the greatest weight to the predominant reac- 
tion, which in the case of radio programs is like. The S-score gives more 
even weight to all reactions, which in the case of reactions to radio pro- 
grams, gives more weight to dislike. Such additional weight seems to be 
justified since It is highly likely that in a situation which is positively 
toned, any degree of dislike may have more significance than is indicated 
by a percentage, In addition, since it has been shown that some of tlie 
"indifference" reactions are really negative, dislike should be given more 
weight. 

2. The trend of the S-score is maintained in periods of “indijJerenceT 
The S-score does not drop as much as the LD-score at the opening and 
close of the program and during transition passages. The trend of the 
S-score seems to be more justified than the trend of the LD-score at such 
points because these are not really periods of indifference, Analysis of 
listeners’ attitudes during these periods reveals that the listener is not 
indifferent; ho is waiting for something to happen. During transition 
passages and at the end of the program, the listener’s attitude is one of 
relaxation rather than indifference. 

3. Tk S-score units are equal whereas Ihe LD-score units are nol. 
Equality of units permits direct comparison of reactions to programs and 
to program parts, 


JicMiW April 18, 19^, 



Book Reviews 

Luckiesh, M. higU^ mion and ming. Nevr York: D. Van Noatrand Co., 

1944. Pp. 323. $4-50. 

In thSfl treatise Dr. Luckicah gives n aimplified preaentation of tho relation- 
sliipe of light, brightnesa, vision, lighting and seeing. An attempt haa been 
made to combine fundamental facta with practical discussiona, The material 
is aimed to be helpful to those interested in better seeing conditions and thoir 
efifeots upon human elEciency and welfare. The book ia dedicated to '^Better 
Lighi^Better Sight,” a slogan employed by the lighting industry. 

This book will make a strong appeal to tho uncritical reader or to the unin- 
formed reader. It is of considerable importance, therefore, to examine the 
material in some detail. First, however, let us note some of the contributions 
which should receive unequivocal approval; (1) The material ia clearly presented 
in relatively flimplo language. ^ (2) The author makea a strong case for the 
maiutenancQ oE hygienic conditiona for seeing. (3) Desirable emphasis ia 
placed upon the relation of brightness and brightnesa contrast to visibility and 
to ease of seemg. (4) An important placo ia rightly given to the interdepen- 
dence of the four fundamental factors (size, contrast, brightness, and tlme)^ that 
determine the visibility of objects, (5) The measurement of visual acuity is 
adequately handled, (6) One of the best seotions deala with alternation of 
brightnesses and glare in the visual field in relation to efficiency and eABO of 
8cemg. (7) The section on light and color is practical and is DfleclWely done, 

Analysis of the discusBions suggests the following criticiama to the reviewer: 
(1) The author consistently ignores the fact that the eyes readily adapt to easy 
and effective seeing over a wide range of illumination intensities, Emphasis is 
given only to the adaptation for effective vision at the higher levels. (2) The 
diBmieslng ot findings con&icfcing with the author's views by trvoans ot ridicule 
rather than on the basis of sound criticism is both ineffective and a sign of 
weaknesa, Thus we find employed auch terms as "sheer nonsense," "tho valor 
of ignorance," "gross ignorance/' "ridiculous,” and "meaninglesfl” to ejcpress 
the author's reaction to the contributions of others. (3) Several decades of 
work in the field of yicion is no critcTion of infallibility, FurthcTinoTei the 
recurring phrases "it is axiomatic" or these "facts are axiomatic" become un- 
convincing, since in certain instances the critical reader will recognize that they 
arc neither facts nor axiomatic, (4) Relatively high intensities are required 
for adequate seeing where discrimination of details involves low brightness con- 
trast. It does not follow, however, that the same high intensitieB are necesBEiTy 
in the large majority of everyday visual eituations. This distinction is not 
made clear. (5) In considering the fixational pause of the eyes, questionable 
date are cited although adequate data are available in the literature. (6) In 
citing eye-movement time for reading (page 128), the record is decidedly atypi- 
cal or the computations aro wrong. Duration of the back awcop and other inter- 
fixation movements arc far too long. (7) It is stated that 11 point tjrpo is far 
above the average typography commonly encountered. This ia misleading 
since actual figures show that journals and books arc typically printed in 10, 
11 or 12 point type. (8) The author's attitude toward rate of reading as an 
indicator of ease of seeing is highly inconsiatent. Thus: (a) "It is axiomatic 
that if very poor seeing conditiona are improved . . . quantity of useful work 
done should improve." (b) "As a criterion of optimum levels of illumination 
. . . rate of performance of a visual task is inadequate,” (c) Nevertheless 
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Bpeed of reading ia employed to measure influence of brlghfcncaa contrast between 
print and background, (d) best, speed of reading is* an insensitive cri- 
terion^^ of oase of reading, (e) But the author employs eyG-movement meas- 
ures (perception time, fixation frequency, pause duration, regression frequency) 
in reading to show the effect of variation in level of illumination. He concludca 
that the effects of fatigue are obviously greater for the low level of illumination 
as is evidenced by the change in eye-movement measures. Apparently the 
author do eg not realize that eye-movement measures are merely measures of 
speed of reading, It BGoma that rate of perception (reading) is accepted as a 
criterion of ease of seeing only in situationB where the result 0 aupport his views. 
(9) To meaaure case of seeing the author usually obtains results for one versus 
100 foot-candles, or one veraus 10 versua 100 foot-candles. It is obvious 
that, in any visual situation where discrimination is concerned, one may expect 
improvement in visual efficiency in going from one to 100 foot^candlea, or even 
from one to 10. And where diBcrimination is severe improveraent is probable 
from 10 to 100 foot-candles, Luokiesh himself suggests that, to obtain a 
significant improveraent in, geeing,* one should double the foot-candle level. 
He also states that one is generally more concerned with the practical optimum 
(level of illumination) than with the absolute maximum for many ordinary 
tasks. It is pertinant to aak, therefore, why he does not employ in hia studies 
1, 2, 4, fi, 16, 32, 64 and 128 foot-candleB rather than only 1 versus 100, or J 
versus 10 versus 100, ^ Responses at various levels from ID to 100 foot-candles 
have not been investigated. Possibly the rate of change in efficiency ia ex- 
tremely slow from 16 or 20 to 100 foot-candlea, In the majority of visual situa- 
tions which involve details considerably above the visual threshold in size, we 
are interested in knowing the level of illumination above which no practical 
gains in efficiency occur. This cannot be revealed by, Luckiesh's data. (10) 
The use of heart rate, the blink technique and visibility measurements ae 
criteria of ease of seeing have been criticized in another paper.^ An additional 
comment may be made. The reliability of blink acores for a five minute period 
of reading ig low ( + .49). Algo one may question the stability of some differ- 
ences obtained. For example, Memphis medium type ia called easier to read 
than Memphis bold because 7 per cent more blinks occur with the bold in five 
minutes of reading. About 25 blinks occur in five minutes. Thus the bold 
would be rend with 1.6 more blinks per period, With only 18 to 40 subjects, 
is this a stable difference? (11) The author delights in setting up straw men 
so that they may be knocked down. Thus he implies that someone has stated 
that 10 foot-candles is enough for any kind of reading— which has not been done. 
Then he points out the need for relatively high intengities needed for people 
with eye disabilities and for reading very illegible type — to which no one 
objects. 

Dr, Luekiesh has written an interesting and important book. The treat- 
ment of several topics may be considered excellent. Much of value may be 
gained from the rest of the material if read critically. 

Miles A. Tinker 

Univsmty oj Minnesota 

^ Tinker, M. A. A reply to Dr. Luekiesh. J. appl. Psychol, 1043, 27, 46M72. 
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Intelligence and Adjustment Measurements in the Selection 
of Radio Tube Mounters 

George Foilano * and Forrest H. Kirkpatrick 

UaiiQ C&rporaiion oj Amerim lieOiany CoUtge 

The general problem with which this etudy was coacei-ned is the in- 
crease of worker efficiency in radio tube mounting jobs. Specifically the 
problem reduced to: will intelligence and adjustment tests be effective in 
bringing about this desired increase in efficiency? There have been many 
claims as to the effectiveness of adjustment teats in particular in the 
selection of more desirable workers, but there have been too few quantita- 
tive presentations of proof. Vague opinions of personnel officers that 
the use of testa brings superior employees are too often accepted without 
evidence. 

The subjects employed in this experiment were twenty female tube 
mounters in one department of the Indianapolis Plant of the Radio Cor- 
poration of America, Tube mounters assemble the very small tube ele- 
ments to the bases of radio tubes. It is very close work requiring con- 
siderable finger and hand dexterity. Several mounters, each performing 
distinct operations, work together on each tube. The subjects were new 
employees who had taken the required placement tests, and had been 
assigned as tube mounters. New employees were used in the experiment 
because it was desirable to keep all regular workers on the production line. 

The testa used for the purposes of this experiment were the (1) Otis 
Self -Administering Test of Mental Ability Form B, (2) the Bell Adjust- 
ment Inventory, adult form, and (3) the Washburne Social Adjustment 
Inventory. Of the latter two tests only the scores which are designed to 
measure social adjustment were used. This included the ^‘social'^ score 
of the Bell test and the “alienation^' score of the Washburne teat. These 
were administered before the employees started work. The subjects also 
took the regular aptitude battery (a vision test, ft two-hand coordination 
test, and manual dexterity tests) with which we shall not concern ourselves 
in this report. 

* Now in the U, S, Army. 
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The criterion used for tliis experiment waa ratings by the Hupervisor in 
charge of the group. Each worker was rated for the extent to wliich she 
took hold of the job and performed efficiently. These ratingg were given 
on the basis of one month's observation of the worker at tier task. The 
supervisor's ratings were in the following terms: G, indicating a good 
employee; and F, indicating a fair employee. 

For purposes of examination of the data, teat score distributions were 
divided into three groups and scores within the groups assigned the values : 
above average, average, or below average. Table 1 gives the groupings 


Table 1 

Distribution of Test Score Values to Various Groupings 




Grouping 


Test 

Above Avoi ago 

Average 

Dclow Averago 

Otis Mental Ability (I.Q.) 

Bell Social Scores 

Washbunio Alienation Scores 

115 and over 

6 to 8 

0 to 5 

05 to 114 
Oto 10 
Gto 15 

04 and below 
20 Lo 24 

10 and above 

Table 2 

Showing Mounters’ Teats and Related Data 


Composite 

Intclligonco 


Tube 

Mounter 

Supervisor's 

Ratings 

Otia 

I.Q.'s 

Personality 

Rating 

and 

Personality 

1. 

G 

125 

+av. 

12 

2. 

F 

122 

-av. 

6 

3. 

G 

122 

av. 

0 

4. 

G 

122 

+av. 

12 

6. 

F 

118 

-av. 

6 

0. 

G 

118 

av. 


7. 

F 

118 

av. 

0 

8. 

F 

114 

— av. 

3 

9. 

G 

111 

-hav. 


10. 

F 

101 

— av. 

3 

11. 

G 

98 

av. 

G 

12. 

G 

97 


0 

13. 

F 

95 

av. 


14, 

F 

01 

ftV. 

3 

16. 

F 

80 

— av. 


10. 

F 

78 

— av. 


17. 

F 

70 

av. 

3 

18. 

F 

72 

— av. 

0 

19, 

G 

60 

av- 

3 

20. 

F 

95 

av. 

3 
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uaed. These divisions were based on distribution of scores into upper, 
middle, and lower thirds. 

The two personality test scores were then combined in such a way that 
i( a worker made above average on both testa she was rated “+ average"' 
for personality; if she received above average on one test and below on 
the other, or if she was average on both, she was rated ''average” in per- 
sonality. Likewise, if the worker made below average on both tests she 
was rated "-average’" in personality. These are the figures shown in 
Table 2 under the heading "Personality Rating.” 

Table 2 also shows a column headed "Composite Intelligence and 
Personality,” These figures were obtained by weighting an above average 
persona/ity rating or Otis score as 6, an average rating or score as 3, and 
a below average rating or score aa 0, and then adding the two weights for 
each pemon, Hence, the composite could range from 0 (below average 
Otis score + below average personality rating) to 12 (above average 
Otis score + above average personality rating), Table 2, then, contains 
the basic figures from which experimental results were studied. 

Inkelligenc© and Job Success 

Table 3 shows the relationship of intelligence test scores to the ratings 
of job success. For employees with average and above average scores 
there were exactly the same number rated “good” by supervisors as there 

Table 3 


Pwtribiition^ of Intelligenco Test Score® for '^Good^' and 'Tair" Emplgyecfl 


Test Scores 

Rated ^‘Good'* 

Rated "Fair’' 

Above Average 

3 

3 

Average 

3 

3 

Below Average 

1 

6 


Were rated “fair.” However, 6 out of 7 who were below average in intelli- 
gence had been rated as “fair” by the supervisor. It would seem from these 
results that low intelligence would go with poor job success while above 
average intelligence does not give advantage over average. This might 
have been expected since, although it takes a certain amount of intelli- 
gence to learn the job, there ia not much to tax mental capacity after it is 
Iciarned. 

Social Adjustment and Job Success 

Table 4 summariaes the relationship between personality test scores 
for social adjustment and ratings of job success. The scale indicating 
"social adjustment” here is the combination of Bell and Washbume scores 




260 


George Forlano and Foned //, Kirkj)alnch 


giveu under “Personality Rating’' in Table 2. These lesults are rather 
striking in that all of the people scoring above average on the testa also 
were rate^ “good” by their auperviaor, while all of the people scoring below 
average on the tests were rated “fair” by the supervisors. Whether this 


Table 4 

Difltributionfl of Personality Hafitigs for "Good” mid “Fair’' Employeca 


Teat ScoTca 

Billed “Good" 

Rated "Fair" 

Abovo Average 

4 

0 

Average 

4 

h 

Below Average 

0 

7 


indicates that a socially adjusted personality ia an important factor in 
doing good work, or that the supervisor was more influenced by the girls' 
“personalities” than their performance, is uncertain. Certainly the testa 
were measuring something which was related to the guperviaor's notion of 
good and fair employee risks. 

Job Success and the Compoaitc Score 

When the intelligence and personality scores are combined in the 
manner indicated in Table 1, distinction between “good” and “fair” ein- 
ployeea ia apparent. Table 6 ahowa that by eliminating all the employees 


Table 6 

Composite Intelligence and Peraonality Score Diatributions for 
"Good" and “Fair" Workers 


Compoaite Score 

Rated "Good" 

Iliit4}d "Foir" 

12 

2 

0 

Q 

4 

1 

6 

1 

4 

3 

1 

5 

0 

0 

3 


who had a composite score of 3 or leas, we would have left 88% of the 
“good” employees and only 30% of the “fair” employees. 

Moreover, by eliminating emplpyeea whose composite scores are 6 or 
leas, all but one, or. 92%, of “fair” employees would be eliminated. At 
the same time only 2, or 25%, of “good” employees would be lost. It 
would seem from these Bgures that, in times of a favorable labor market, 
these tests would be very effective in selecting workers able to meet with 
the approval of supervisors. 
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Summary 

This study was concerned with the effectiveness of certain personality 
and intelligence measures in predieting the job success of 20 tube mount- 
ers. Relationships were shown between supervisory ratings of j ob success 
and scores on the Otis Self-Administering Test of Mental Ability, Form 
B, the social scale of the Bell Adjustment Inventory, and the alienation 
scale of the Wasliburne Social Adjustment Inventory. The following 
conclusions were drawn: 

(1) Low intelligence scores tended to indicate the poorer workers. 
Average or above average scores did not discriminate between "good" 
and "fair” workers. 

(2) All workers scoring below average in social adjustment had been 
rated only "fair” by the supervisor while all workers scoring above 
average in social adjustment had been rated "good" by the supervisor. 
The supervisor had no previous knowledge of test scores. 

(3) A composite of intelligence and personality scores was shown to 
be effective in predicting the subsequent success of new tube mounters. 


Reenved July 38, i9U- 



Single-Item Tests for Psychometric Screening * 

Lieut. H. M. HUdretli, USNR 

A series of 10 Single-Item Tests are presented in this article. These 
tests, designed for paychometric screening, were developed at a Naval 
training station in response to the need for rapid methods of examining 
the intelligence of large numbers of recruits. They take from 1 to 2 
minutes per man to admiiiiater, and do not require optimal testing condi- 
tions. Standardized on 1>500 cases they have also been tested in actual 
practice and found to be practicable. In a 3-month trial period, during 
which the teats were used os a basis for accepting recruits for service, the 
error involved was found to be leas than 1/10 of 1 per cent. 

A New Approach to the Problem of Screening 

Single-Item Testa are the result of a new approach to the screening 
problem of increasing speed of, testing without losing accuracy. The 
usual approach has consisted of abbreviating, and devising short forms of, 
standard mental teats. These short forms bring testing time down from 
an hour to around 10 or 16 minutes, without appreciable loss of accuracy; 
but this is about the limit to which standard-type tests can bo skeletonized 
without sacrificing reliability. 

The reason for the limitation of this approach lies in the psychometric 
requirements imposed by the purpose of mental measurement. In the 
past this purpose has always been to determine the true or 'maximum 
mental ability of the individual. Standard tests, including those recently 
streamlined for screening, have always been designed and constructed to 
measure this maximum. 

In psychometric screening the individual’s maximum is not a matter of 
concern. The purpose in screening is to make sure that a recruit’s mental 
ability is not below a given minimum and that he is thereby acceptable for 
naval or military service. Tests for acceptance need measure only this 
minimum; it is not necessary to mensure maximum ability. 

Recognition of this basic difference in purpose makes it possible to 
dispense with 3 traditional psychometric requirements. In tests for 
maximum ability; (1) many items are ordinarily included in the test so 
that the individual will have ample opportunity to demonstrate his full 

* Th« opiniaoB or assertions conUinsd in this article are the private ones of the vpiitor 
and sra not to be construed as oIEoial or r^eotieg the views of the Navy Department 
or the Naval Service at largo. 
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ability ; (2) failure is accorded as much significance as success, since the 
failure level of an individual must be determined if his maximum per- 
formance is to be knoTvn; and (3) scoring of failure requires in turn that 
maximum-ability tests be administered under optimal testing conditions. 
Unlike Biicceaa, which demonstrates the presence of ability, failure does 
not neceaaarily indicate lack of ability. It may be due to distraction, 
confusion or anxiety, and until these and similar extraneous causes are 
eliminated, failure cannot be taken to mean "lack of ability/^ 

In testing for minimal mental ability none of these lequirementa need 
be considered. One success is sufficient to establish a minimum. A re- 
cruit who is successful on a single item demonstrates he has at least the 
degree of mental ability called for by that item. He may well have more, 
but it IB certain he does not have leas. If the measuring power of the 
particular item has been determined, then a minimal mental ability can be 
ascribed to the man at once and without further tesbing.*^ 

Ordinarily, however, only the average difficulty of test items is known. 
The minimal mental ability which they represent is not known. To ob- 
tain this information, and make possible the use of single items as screen 
teats, the special scoring technique described below was devised. 

Scoring Technique 

The technique used in scoring items for screening consists of tabulating 
for a normal group the mental ages of all those who are succesaful on a 
given item, and then determining the point at which this distribution 
becomes asymptotic to the mental-age base line. Those items found to 
represent a minimal mental ability of the desired degree are suitable as 
screen teats. 

The desired minimum in the present case was H years, or 132 months, 
mental age, the minimal mental ability for Naval service originally set by 
official directives. Thirty items from well-known teats (1, 2, 3) were 
selected for scoring. In conjunction with a Stanford-Binet examination 
these 30 items were administered under optimal conditions to 1,500 men of 
military age. Care was taken to assure a normal distribution in respect 
to mental age, particularly in the lower brackets. 

Each of the 30 experimental items was then scored for minimal mental 
ability. (1) A frequency distribution was made of the mental agea of all 
those who passed the given item. Failures were disregarded. (2) The 
point at which the distribution approached zero was located. For pn'icti- 

* The foregoing applies to freo-responao items aiich os those used in the S-I Teste. 
Success cannot be considered prima facie evidence of ability in multiple-choice or true- 
false items where an appreciable element of ohanco present. Coaching, of course, 
invalidates any mental teat. 
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cal purposes this point was set at the Brat perccntilcj with the one-half 
percentile point also being computed. (3) The mental agca correspond- 
ing to these points were determined. If the mental age nt the first 
percentile was 132 months or greater, the item was considered suitable as 
a Single-Item Teat for acreening. 

In the ‘^Squares^' problem below, for example, all individuals in the 
standardization group passing the item were separated out and their 
mental ages were tabulated in a frequency diatribution. The first per- 
centile of this diatribution was computed and found to be 132 months. 
Since this value was not below the dcaired minimum, tlic item was con- 
sidered suitable as S-I Test. The chances are less than 1 in 100 that a 
recruit who passes this test during screening will have a mental age below 
132 months. 

Of the 30 experimental items scored 'm this manner 10 were found to 
guarantee mental ability above the Navy minimum. These 10, desig- 
nated as Single-Item Tests, are described below.^ 


Description of Single-Item Teats 

In the column headed P = MO is listed (in months) the mental age 
value at the first percentile. The probability is .99 that an individual 
passing the S-I Test will have a mental age at or above that H.sted in the 
table. Tor column P = M5 the chances are 199 in 200 that the indi- 
vidual will not be below the mental age listed there. These probabilities 
are in terms of a normally distributed male group of military age, as found 
at an induction center. This is the group customarily dealt with in 
screening,^ 

Scoring of the Kent and Stanford-Binet items is in most instances 
identical with that originally described for these items. 


1. Question: 

7 times 7 

8 times 8 

9 times 9 


“How much is : 

10 times 10 

11 times 11 

12 times 12 



Scoring; Paaa if subject makes no more than two errors. 



* It will be noted that aoino of the values in LLia table are below 132 months, but not 
below 126. It has been found in practice that 126 is a safe value bo use bccaiiso of the 
conditions under whieh screening is usually dona, and becauso Stnnfavd-Biuot scores on 
flubnormnla bend to run somewhat lower than the Wcchslcr-Bcllovuo (4) which is fre- 
quently used for doteTmiiung mental age. Scoring of WechBler'Bellovuo items for screen- 
ing ia now under way. 

® When testing is limited to doubtful caacs nil of whom ate Buapccted of meutal 
deficiency success may be conservatively interpreted in terms of this group, The 
probability is less than .05 that an individual whoso mental age is below 11 years will 
pass any given S-I Teat. The null-typo hypothesis that the individual ia defective is 
then disproved by his euccess. 
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2. Question: “What does the word PRICELESS mean? 133 126 

Scoring; Pull credit for such rcsponsea as “very valu- 
able/^ “you can't buy it for any amount of money,” 

“it ifl worth a lot.” If the Bubjecb aays “Ib haa no 
price, “ ask what he mcana. Make sure ho really 
knows the meaning of the word. 

3. Question: “If your shadow points toward the north- 
east, in which direction is the sun?” 134 128 

Scoring: Credit if response is “Southwest.” 

4. Question: “What docs the word TOLERATE mean?” 142 139 

Scoring; Puli credit for such responses as “it means to 

put up with things," “it means you stand for what 
people do without getting mad,” “it means to be 
lenient,” “to endure.” Do not credit such re- 
aponaea as “I tolerate you” unieaa the subject can 
follow with a clear explanation. Do not credit such 
responses aa "it's a sickneas — the cholcry.” 

5. Question; “What ia the next number?” 

1 2 4 8 13 139 137 

These numbers are presented in written form. 

If subject hesitates, aay "These numbers go up in a cer- 
tain order; what would be the next one?” 

Scoring: Credit only if the subject says “32” and is able 
to explain that the numbera are being doubled. 

6. Question: “Why does the moon look bigger than the 
stars?” 

“What time of day is your shadow ahor test?” 136 132 

Scoring: Full credit if both questions are nnawered 
correctly. 

Por the first question credit such responses as “the moon 
is closer (nearer) to the earth/' “the stars are farther 
away.” No credit for such answers as “the moon is 
bigger”; give assurance that the moon is really 
smaller, and repeat the question. 

Por the second question, credit "noon” or any time be- 
tween 11:00 and 1:00. No credit for “night” or 
“4 o'clock.” 

7. Question; “What is the opposite of WINTER?” 

“What is the opposite of WAR?” "What ia the 

^ opposite of BROAD?” “What is the opposite of 136 126 

ALIKE?” “What is the opposite of DEEP?” 

Scoring: Pull credit if subject can give the opposite of 
four of these words. 

8. Question: “Make a good sentence out of these 

words.” 129 126 

POR THE STARTED AN WE COUNTRY 
EARLY AT HOUR 

These arc presented to the subject in written form. 

Scoring: Pull credit for “we started for the country at 
an early hour,” “at an early hour we started for the 
the country,” “We started at an early hour for the 
country.” 

9. Question: “What does the word MARS mean?” 

“What does the word HYSTERICS mean?” 130 127 

“What does the word BRUNETTE mean?” 
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Scoring: Pasa the subject if the meaning of each of the 
words can be given. 

Por MARS give credit for ''planet^^ or ''the God of War.'* 

No credit for "it ia up in the sky/' "it is a place," 

"it is a country," "it ia a candy bar," 

For HYSTERICS give credit for "it is nervous aick- 
neaa," "it ia like having a fit of crying," "to get 
excited and go all bo pieces," No credit for "it ia 
about old times" (historic)* 

For BRUNETTE give credit for "dark complexion," 

"black hair," "a person who is dark." No credit 
for "a blonde," "it ia a woman," "red hair." 

10. Question: "In what way arc a KNIEE-BLADE, 

a PENNY, and a PIECE OF WIRE alike?" 129 120 

Scoring: Full credit if response ia "metal." No credit 
for "copper," "steel," "they are useful," or "they're 
all hard," 

P = ,990 P ^ .996 
Use of S-I Tests in Screening 

Each of the 10 S-I Tests above ia an independent test of acceptance. 
Success on any one of the teats demonstrates mental ability above the 
minimum for Naval training/ No attention need be given to providing 
optimal testing conditions. A distracting situation does not invalidate 
an S-I Teat; on the contrary it increases the significance of the recruit's 
success, When privacy ia not available and the replies of one man can 
be overheard by those next in line, the tests can be used in rotation, each 
man receiving a different question. 

The majority of men pass the first teat given them promptly. Failure 
on any or all of the S-I Teats, however, does not mean that a recruit is 
necessarily below the required mental minimum. Confusion rather than 
lack of ability may cause the failure. If the recruit is unsuccessful in 
several tries, he should be held over for further examination. 

This subsequent examination may include more elaborate phases of 
acceptance testing (5). It may also involve testing for rejection with 
the usual full-length psychological tests. These "many-item" tests, de- 
signed to measure maximum intelligence, are necessary before a decision 
to reject can be made, and the more hours available for thorough rejection- 
testing of this group the more men can be salvaged for service. Single- 
Item Tests, by speeding up acceptance, save time for the more careful 
examination of these borderline cases. 

* Present data indicate that when testing is continued until 2 S-I Testa are passed, 
3 months may be added to each of the lower values. E.g. if the first and second teats 
are passed the new minimal values would be 136 and 129 for tho 2 degrees of probability. 
In aome coses, but not ^11, this will establish a higher minimum than that given for either 
of the 2 tests. 
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Single-Ilem Tests for Psychomelric Screening 
Summary 

Ten Single-Item Testa for use in psychometric screening are described. 
These teats, the result of a new approach to the problem of screening, 
require 1 to 2 minutes per man to administer. Success on any one of them 
denotes mental ability above the minimum required for Naval training, 
S-I Tests for rapid acceptance allow more time for rejection-testing of 
borderline cases, many of whom can be salvaged when additional examin- 
ing time is available. 

Received JulyS, 
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Range of Interests 

Ralph F. Berdie 

JAeut, [jg), U.S.N.R. 

Everyday ohaervation and clinical experience suggest that the well 
ftdjuetediadividual has a wide range of intereata and that other individuals 
who are experiencing conflicts within themselves and with their gocini 
environments tend to have more restricted ranges of interests. Nar- 
cissism accompanies many psychological malfunctions, and inability to 
attend to and maintain interest in occupational and extra-vocational 
activities often characterizes the neurotic adult. Extreme egocentricism 
is normal in infants and very small children. In physically mature 
individuals it indicates a lack of personality development or n regression 
resulting from various psychological frustrations. This regression may 
be as complete as that we observe in the advanced case of schizophrenia, 
or it may be more subtle. 

Experience again suggests that the ranges of interests possessed by 
normal persons may vary widely and that some otherwise abnormal per- 
sons may have interests that do not differentiate them from normal 
people. A suspicion is justified that a few abnormal persons might have 
unusually wide ranges of intereata and that this extensity of interest may 
or may not be related to their abnormality. 

Very little relevant, systematic information is available regarding this 
problem of the relationship between the range of interests and other 
psychological attributes. The range of intereata, as measured by the 
number of items marked as liked or disliked on the Strong Vocational 
Interest Blank, was found in one study ' to be slightly correlated with 
high, school and college grades and morale and social adjustment scores 
of the Minnesota Personality Scale. These correlations, ronging from 
—.18 to -1-.23 and determined on a sample of 411 college freshmen, were 
statistically significant but were too small to be of any value in predicting 
adjustment. The items liked on the Strong test are determined to a far 
greater extent by the person’s vocational interest profile than by his 
personal adjustment, That is why the items were selected. The rela- 

* The opinions or assertions containod hotein arc tlw privato ones of tUo writer nnd 
are not to be construed as official or reflecting the views of tho Navy Dopartinont or tlio 
Naval Servite at large. 

‘ Berdie, R, F. Likee, dislikes, and vocational interests. J. appl. Psychol,, 1943, 
27, 1B0-18B. 
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tionship fo\ind between range of interests and adjustment, however, sug- 
gests that items selected with the purpose of predicting adjustment rather 
than differentiating vocational interests might have a greater prognostic 
value. 

The problem of predicting personal adjustment is particularly im- 
portant to military psychologists attempting to eliminate those misfits 
from the aervico who, if allowed to remain, will eventually break down so 
as to endanger themselves and their fellows and shoulder the government 
with rehobilitatiozi and pension costs. 

Each man entering military service passes through at least one psy- 
chiatric screening. The type of screening depends on the available staff, 
the time allowed, and the facilities at hand, but in each case an attempt is 
made to determine if the man presents an adequate military risk or not. 
The pressure of work requires that the psychiatric screening be quick and 
even in those places where time for more extensive study is available, 
complete personality studies are not feasible. 

Mental deficiency and illiteracy can be determined with relative sim- 
plicity. The frank psychotic, the organic deteriorate and the obvious 
misfit can be selected with but little more difficulty. Other cases, such 
as anxiety neurotics, hysterical personalities and constitutional psycho- 
pathic states, are more difficult to identify. 

The problem attacked in this study concerned the usefulness of the 
range of interests in selecting potential psychological misfits at the begin- 
ning of military training. Does the range of interests possessed by an 
individual bear a relationship to his military adjustment and can this 
z’ange bo adequately measured? Are criteria available against which we 
can evaluate the predictive value of such a measure and finally, is such a 
measure useful in the military situation? 

The study is divided into two sections. The first concerns a list of 
interest items presented orally to recruits. Here are discussed the ques- 
tions of how stable the likes are from group to group, how the range of 
interests is related to ability and how well it differentiates between normal 
and abnormal recruits. 

The second section of the study concerns a list of interest items pre- 
sented in printed form to recruits. Here are discussed the questions of 
how reliably this list measures the range of interests, what the relationship 
between the range of interests, age, and education is, and how well it 
differentiates between normal and various groups of abnormal recruits. 

Orally Presented List 

A group of 31 activity interest items were pre-tested on a group of 
marine recruits and 22 of these items were liked by over 50 per cent of the 
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men. These 22 items were retained to form the interest scale. The items 
are presented in Figure 1. 


Name Age Platoon No.^ 

Highest school grade completed: at years of age. 

DiRBCTiONfl: Below is a list of thinga people do for recreation. Place a check 
(X) after the name of each thing you LIKE TO DO. After those things 
you dislike or have never done, leave a blank space. 

play checketB Fishing. ............ ...... 

Play pool Hiking 

Play horseahoes Gotocarmvals 

X)anc 0 Go on picnics .... i . . , , 

Oo on dates Heading 


Box 

Play cards .... 
Go to parties . . 
Play basketball 
Play baseball . . 
Play football . . 


— Go to movies . . 

— Listen to rajdio. 

— Holler skate , . . 

— Watch baseball 

— Watch football. 

— Go swimming. . 


Fiq. 1. Interest list presented to marine recruits immediately after physical oxaraination. 

Tho items were then presented in individual interviews to 200 marine 
recruits selected at random at the completion of their physical examina- 
tion.^ In the interview the examiner said, 

'T would like to find out what things you like to do. I will name theoe 

things to you and you tell me if you like to do them or not.'^ 

The items were presented in the order they appear in Figure 1, the 
examiner saying, '^Do you like to play checkers?", "Do you like to go out 
on dates?", etc. With the last item, if the man said he was married, he 
was asked, ^^Did you like to go out on dates before you were married?" 
If the recruit said he liked the activity or disliked it, the examiner recorded 
the response. If he said he did not know or had no contact with the 
activity, this was recorded as an "indifference" response. Some subject 
tive judgments were necessary in recording the responses but any state- 
ment connotating acceptance ("I like it sometimes") was recorded as a 
"like," 

The list of items was then presented to 68 marine recruits recom- 
mended by the psychiatric unit to the aptitude board for inaptitude dis- 
charges, These recruits were all literate and none were mental defectives. 

’ The representativeness of this group is ovidonced by tho moan General Clasaifica- 
tlon Test sooie of 101,8, SD * 16,8 for 172 of the men for whom GiC.T, SDores were 
available. 
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Their difficulbies included anxiety neuroses, hysterical states, epilepsy, 
enuresis, coUvStitutional psychopathic states, post-traumatic syndromes, 
and psychasthcnia. They ^vere a very heterogeneous group of non- 
psychotic psychiatric cases. 

Each man had been interviewed at least twice by a psychiatrist and 
twice by a psychologist and psychological test scores and verified social 
histories were available for many. In each ease the decision had been 
made that their problems would prevent them from making an adequate 
military adjustment. These decisions were all made before the presenta- 
tion of the interest list. 

Two indices of range of interest were obtained from the responses to 
the items. The first consisted only of the number of items liked. The 
second was based upon weights assigned to each item upon the basis of 
the percentage of the number of cases liking the item. A man not liking 
to listen to the radio, an activity liked by 98 per cent of men, is more of a 
deviate than one who doesn't like to dance, an activity liked by only 53 
per cent of men. By weighting each response in direct proportion to the 
extent to which it indicated an individual was a deviate, we hoped to 
obtain a more differentiating score. The results showed that the scores 
based upon the weights gave no better differentiation than the scores 
consisting merely of the number of activities liked. 

Results 

The stability of interests from group to group is important. Will 
interest items rank themselves in the same order of popularity in different 
samples or do conditions affecting the popularity of different activities 
vary from group to group to such an extent that interest in these activities 
cannot serve as a basis for constructing a scale for general use? Are there 
items which have a well defined place in the recreational hierarchy of adult 
males in America? 

The 22 items were ranked according to the proportion of the first 50 
subjects who reported liking the items and then ranked according to the 
proportion of the second 50 subjects who liked the items. The rank order 
correlation was .89. The same thing was then done on the basis of the 
likes of the first and second one hundred subjects and again the rank order 
correlation was .89. 

In almost any group of American men selecfced at random, between 90 
and lOQ per cent will report they like to go to the movies, about one-half 
will report they like to dance. As reported later, age and perhaps educa- 
tional status help determine the individuals^ interests, along with multi- 
tudinous other factors, but in considering groups drawn from the general 
population^ these interests form themselves into a remarkably stable order. 
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General intelligence has frequently been mentioned ns one of the factors 
determining interests. In order to see what relationship existed between 
the total number of likes reported by an individual and his intelligence, 
comparisons on the basis of the number of likes wbb made between groups 
receiving high, medium and low scorea on the General Classification Test. 
Teat scores were available for 172 of the 200 men selected at random. 
They were divided into three groups} 37 who had G.C.T. scorea of 110 
and above; 47 who had scores of 89 and below, and 88 who had scores of 
between 90 and 109 inclusive. The cumulative percentage distributiona 
of the number of likes for the tliree groups are presented in the first three 
columns of Table 1. 

The average person in the low ability group likes 18 plus items. The 
average person of the medium ability group likes 18 plus items. The 


Table 1 

Distributions of Number of Likes Obtained with Orally Prc.scntod List for Three 
Different Ability Groups, Group of Diecharged Recruits and Normal Recruits 


No. of 
Itema 
Liked 

G.aT.=:110 
and Above 

G.C.T. = 89 
and Below 

G.C.T. 

=: 00-100 

InnptiludQ 

Discharges 

Normal 

llecruita 

Preq 

Cum. 

% 

Frcq. 

Cum. 

% 

Freq. 

Cum. 

% 

Frcq. 

Cum, 

% 

Froq, 

Cum. 

% 

22 

1 

lOO 

1 

100 

6 

100 



7 

100 

21 



3 

98 

11 

05 



15 

90 

20 

0 

97 

5 

02 

Ifl 

82 



30 

80 

19 

2 

81 

9 

81 

0 

64 

1 

100 

21 

74 

18 

0 

7G 

6 

62 

11 

54 



35 

63 

17 

4 

b1 

5 

40 

10 

41 

5 

08 

22 

45 

10 

7 

a 

0 

30 

11 

30 

2 

01 

30 

35 

15 

4 

22 

B 

20 

3 

17 

1 

88 

14 

20 

14 

3 

11 

2 

13 

5 

14 

3 

86 

10 

13 

13 





2 

8 

7 

82 

3 

8 

12 

1 

3 

1 

9 

2 

6 

9 

72 

5 

7 

11 







8 

60 



10 



1 

6 

1 

3 

9 

47 

3 

4 

0 



2 

4 

1 

2 

4 

34 

3 

2 

8 





1 

I 

5 

28 

2 

1 

7 







4 

20 



6 







3 

15 



5 







2 

10 



4 







2 

7 



3 







2 

4 



2 







1 

1 



Total 

37 


47 


88 


68 


200 
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average person of the high ability group likes 17 items. Inspection of the 
columns reveals little or no significant difference betiveen the number of 
items liked by the three groups. This is particularly evident when the 
figures for the ability groups are compared with the figures for the dis- 
charged and normal* groups, which will be discussed later. The con- 
clusion seems warranted that, with this particular list of items, the range 
of interests bears little relation to general intelligence. 

The primary question about the list of items is how well does it differ- 
entiate between people who are making a good adjustment to military 
training and people who are not. The answer is found In the last two 
columns of Table 1. 

The column to the left presents the accumulative percentile ratings of 
the 68 inaptitude cases and the column at the right the same thing for the 
200 normal cases. These figures are baaed on simply the number of likes 
reported by the individuals. The range for the inaptitude cases ia from 
2 to 19, with fifty per cent of the cases liking 10 or fewer items. For the 
normal cases, the range is from 8 to 22, with fifty per cent of the cases 
liking 18 or fewer items. Of the inaptitude cases, 20 per cent like fewer 
items than any of the normals while of the normals, 37 per cent like more 
items than do any of the inaptitude cases. By choosing a critical point 
at 13 items, we would eliminate only 8 per cent of the normals and 82 per 
cent of the inaptitude cases. Such a email degree of overlapping is almost 
unprecedented when payohologioal instruments are used. Little question 
can be raised that the normal and atypical groups studied here most 
certainly differ on the basis of the number of likes they report. 

Printed Interest List The preceding discussion concerns data col- 
lected in a brief, standardized interview. The collection of information in 
personal interviews has certain disadvantages, however, when dealing with 
largo groups. As has already been mentioned, this method in a few cases 
requires the interviewer to make judgments as to whether the subject's 
response indicates liking or not. To facilitate the collection of informa- 
tion and to eliminate any variability associated with the interviewer, the 
interest list was presented as a check list. A copy of the list and instruc- 
tions as presented to the subjects is presented in Figure 1. 

The mimeographed interest list was presented to 792 marine recruits, 
all the members of eleven consecutive platoons, immediately upon the 
completion of their physical examination and just prior to their interviews 
with the psychiatrists. Of these 792 men, 23 were selected by the psy- 
chiatrists to return for further examination because of suspected illiteracy 
and/or mental deficiency. Another group of 25 recruits was selected to 
return because of suggestions of other psychiatric or psychological defects 
— psychoneuroais, epilepsy, etc. 
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The check list was also presented to 114 recruits who had been thor- 
oughly studied by the psychiatrists and psychologists and who were being 
recommended to the aptitude board by the psychiatric uuit for inaptitude 
discharge. These were almost all of the recruits not of defective or bor- 
derline intelligenco who were recommended to the board over a certain 
period of time. They were given the list after the final (Iccision had been 
made to lecommend their discharge. All of these recruits had at least 
two interviews with a psychiatrist and one with a psychologist. Most of 
them had been seen twice by a psychologist. Many had several contacts 
with both psychiatrists and psychologists and many had been carefully 
ohsci’ved in a special observation unit or carefully studied in the neuro- 
psychiatric ward of a Naval hospital. Social histories available for most 
of the recruits substantiated the information which led to the recom- 
mendation for their discharge. This group of discliarged individuals in- 
cluded recruits diagnosed as having an>dety neurosis; constitutional psy- 
chopathic state^ emotional instability; constitutional psychopathic state, 
inadequate personality; psychoneurosis, mixed; post-traumatic syndrome; 
epilepsey; enuresis; psychoneiirosis, hysteria; constitutional psychopathic 
state, schizoid personality; hypochondriasis; psychoneurosis, psychas- 
thenia; somnambulism; constitutional psychopathic inferior without 
psychosis; psychoneiirosis, neurasthenia; cryptic nostalgia. 

Results for the Printed Interest List. The range of scores obtained with 
the mimeographed list was greater and the distribution less skewed than 
with the scores collected in the interview. Therefore the calculation of a 
reliability coefficient was more feasible for tlic written list than for the 
other. Fi’om the total group of 792 cases, 100 cases were selected and 
the odd-even reliability was computed on the basis of the number of likes 
checked on the even numbered items and the number of likes checked on 
the odd numbered items. The cow’ected coefficient was .88, Very few 
psychological tests with only 22 items have reliabilities high enough to 
warrant their use with individuals, 

Vocational interests are known to be influenced by age ^ and common 
sense suggests recreational interests are equally as, if not more, susceptible 
to the influence of increasing age. The ages of 780 of the 792 subjects 
were known. The mean age of this group was 24.4 years, with a standard 
deviation of 7.9 and a range from 17 years to 49 years. The total dis- 
tribution was extremely skewed with 318 of the cases falling within the 
17”18 year old group. The product-moment correlation of — . 13 between 
age and range of interests does not offer a true estimate of this relationship 
because of the skewness. 

^Strong, E. K., Sr. Change of interesla vrilh age. Stanford, Caljf. : Stanford Univ. 
Press, 193 L 
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A better estimate of tlie influence of age upon range of interests was 
obtained by comparing the number of items checked as liked by the 406 
men in the 17 to 22 year old group to the number liked by the 177 men in 
29-49 year old group. The distributions for these t'wo groups are pre- 
sented in Table 2. 


Table 2 

Difltributionfl 0/ Number of Likes Obtained with Printed List for 
DilTcrcnt Age and ISducational Groups 


No. of 
Items 
Liked 

17-22 Yr. Olds 

29-49 Yr. Olds 

17-22 Yr. 03dfl 
8tli Grade 
or Loss 

17-22 Yr. Olds 
H.S. Grad, 
or More 

Froq. 

Cum, 

% 

Froq. 

Cum. 

% 

Frcq. 

Cum, 

% 

Preq. 

Cum. 

% 

22 

32 

100 

10 

100 

1 

100 

10 

100 

21 

21 

94 

6 

94 

4 

99 

5 

90 

20 

30 

88 

7 

02 

7 

94 

7 

84 

19 

22 

81 

7 

8S 

4 

86 

9 

77 

18 

41 

75 

9 

84 

7 

81 

11 

68 

17 

28 

66 

6 

79 

4 

73 

8 

67 

1C 

31 

58 

4 

75 

fi 

68 

9 

48 

15 

30 

60 

6 

71 

8 

69 

4 

39 

14 

2Q 

43 

14 

70 

7 

50 

11 

36 

13 

22 

36 

8 

62 

B 

41 

4 

24 

12 

24 

30 

10 

67 

5 

S2 

5 

20 

11 

20 

24 

16 

61 

4 

2Q 

3 

14 

10 

13 

19 

13 

43 

3 

21 

2 

11 

0 

17 

16 

9 

36 

3 

18 

2 

9 

8 

17 

12 

10 

31 

1 

14 

4 

7 

7 

15 

7 

9 

26 

4 

12 

1 

3 

G 

5 

4 

7 

20 

4 

8 

1 

2 

6 

6 

2 

7 

16 

3 

4 



4 

3 

1 

12 

12 



1 

1 

3 

0 

1 

1 

5 

5 





A 

1 



4 

2 





Total 

406 


177 


85 


07 



111 the younger group, 50 per cent of the men liked 15 or more of the 
activities. In the older group, only 30 per cent liked 15 or more items. 
Ill the younger gi'oup, 12 per cent liked only 5 or feiver items, ivhiJe in the 
older groups 31 per cent liked no more than this many activities. Inspec- 
tion of the table reveals a substantial decrease in the number of activities 
liked as one moves from the younger to the older group. Table 3 presents 
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the per cent of people in eacli of these two age groups and in the groups 
draded upon the basis of education who check each item. In almost 
every case, the difference agrees with expectation. 

Age brings a decreasing interest in dales. The younger men like to 
play horaeshoea more than the older bub this dilTereiicc is influenced by a 
greater preference of the younger, less well educated group. Age ap« 
paxently bears little influence on interest in dancing or on inbereat in 
playing cards. Younger men are more intereated in parties, basketball, 
football and hiking. Older men are slightly more interested in watching 
bELseball and in reading. Inspection of the table indicates that changes in 
interest accompanying age arc not independent of the educational status 
of the individual. 

The above results show that when an individual's range of interests is 
to be used as a personality index, his age must be considered. A man of 
forty years cannot be compared legitimately with a youth of eighteen. 

Table 3 


PetcoatagQ of Vaxioua Groupa Checking lluit They Liked Each Item 


Ifcona 

17-22 Yra. 17-22 Yra, 2M9Yrs. 2(M0 Yrs. 17-40 Yra. 
8fch.Gr. More than 8fchGt. Moro than 8tli Gr. 
or Less 8th Gr, or Leas 8th Gr. or Less 

17-40 Yra. 
More than 
8t;K Gr. 

Play oheoketa 

71 

62 

60 

02 

01 

63 

Play pool 

67 

70 

65 

56 

63 

GO 

Pl&y horeeshocs 

72 

67 

67 

59 

67 

01 

Dance 

40 

68 

41 

50 

41 

59 

Go on da tea 

83 

83 

27 

39 

53 

68 

Box 

46 

48 

22 

32 

30 

42 

PUy cards 

68 

00 

69 

60 

60 

01 

Go to parties 

62 

72 

37 

44 

49 

62 

Play baflketball 

55 

70 

18 

44 

34 

61 

Play basoball 

69 

77 

55 

04 

03 

73 

Play football 

65 

77 

22 

44 

39 

60 

Piahing 

76 

70 

71 

78 

70 

77 

Hiking 

67 

69 

40 

48 

48 

65 

Go to camlvalB 

6B 

68 

44 

41 

53 

66 

Go on picnica 

54 

62 

52 

49 

63 

58 

Heading 

63 

71 

63 

82 

63 

76 

Go to movies 

90 

95 

77 

88 

30 

04 

Listen to radio 

83 

84 

76 

80 

81 

80 

Roller skate 

48 

56 

3B 

33 

41 

48 

Watch baaehaU 

70 

71 

76 

79 

76 

73 

Watch football 

70 

81 

64 

72 

03 

80 

Go swimniing 

79 

84 

69 

77 

76 

83 

No. of oases 

85 

289 

80 

116 

229 

483 
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Table 3 — Continued 


Item 

17-22 Yrs. 

2B-49 Yra. 

Inaptitude 

Discharge 

Caaca 

N ormal 
Matched 
Controls 

Play checkers 

04 

67 

46 

49 

Play pool 

60 

65 

24 

62 

Play horecshoca 

01 

69 

32 

67 

Banco 

64 

61 

27 

47 

Go on dates 

83 

34 

27 

60 

Box 

47 

29 

11 

31 

Play cards 

69 

60 

37 

61 

Go to parties 

69 

41 

24 

48 

Flay boaketball 

67 

32 

14 

37 

Play baseball 

73 

60 

30 

05 

Play football 

71 

34 

26 

39 

Fishing 

76 

76 

62 

78 

Hiking 

50 

46 

17 

37 

Go to carnivals 

65 

42 

27 

44 

Go on picnics 

00 

60 

38 

66 

Reading 

69 

74 

44 

71 

Go to movies 

94 

83 

50 

89 

Listen to radio 

84 

81 

70 

81 

Rolior skate 

53 

36 

16 

46 

Watch baseball 

70 

77 

46 

72 

Watch football 

78 

64 

30 

66 

Go swimming 

82 

74 

34 

83 

No, of caaea 

374* 

204* 

144 

144 


* Thwo total nambeiB of case^a do not correflpond with the totals presented in Table 2 
as some coses for whom complete data were not available were discarded and additional 
cases were obtained to increase the size of the older group. 


Separate normative tables must be used in order to provide a relevant 
frame of reference. 

Range of interests might also vary with the educational status of the 
individual. In order to test this hypothesis a group of high educational 
attainment was compared with a group of lower educational attainment, 
holding age relatively constant. In the group of recruits from 17 through 
22 years of age, complete data were avaiable for 85 men who had finished 
no more than the 8th grade and for 97 men who had at least graduated 
from high school. 

In the higher education group, 62 per cent of the men liked 16 or more 
of the activities. In the lower education group, only 32 per cent liked 
16 or more items. In the higher education group, 86 per cent liked 11 
or more items, while in the lower education group, only 74 per cent liked 
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as m^ny items. Table 2 presents the dUtribiitiDns for tho t^vo educational 
groups. Gompavison of these differencea with those found between the 
two different age groups reveals that much more variation in range of 
interests is related to changes in age than to differences in education, 
although the influence of education is neverfchclGvHS marked. 

The total group for whom complete data were available was divided 
into those recruits who had completed the 8th gmde or less and those who 
had completed more grades than this. Table 3 presents the per cent of 
17-22 year old men and 29-49 year old men in each of these two educa- 
tional groups who liked each of tho listed items. The figures are also 
presented for all of the men who had completed no more than the 8th 
grade and all who had completed more than this. 

Comparison of the two columns of figures for the two educational 
groups shows fewer changes in interests related to education than to age. 
The more educated men show more interest in (lancing, in going on dates, 
in going to parties and in athletics associated with secondary schools. 
The less well educated groups like to play horseshoes more than tho others. 
The differences in interests accompanying change in educational status 
well conform to the oppcjrfcunitiea offered by our educational institutions. 

In order to determine the relative influence of age and education upon 
responses to the items, the 22 items wore ranked in order of popularity 
among the 17-22 year old men and among the 29-49 year old men. The 
correlation between these two rank orders was +.52, indicating aubataii- 
tial shifting of item popularity as one moved from the younger to the older 
group. The iteans were then ranked in order of popularity among the men 
completing 8 grades or less and among the men completing more than 8 
grades. The correlation between these two rank orders was .78. These 
two correlations make plain that, although educational status affects item 
response, age differences are far more effective. 

The author^s impression ia that age differentials must be allowed for in 
evaluating range of interests. Educational differencea, however, need not 
be considered if convenience so dictates, although more exact information 
will be obtained if these differences are also taken into account. 

The primary question here, as it was with the oral list, is how ^vell does 
this list differentiate between people who are making a good adjustment to 
military training and people who are not. 

Data were available for the three groups of non-adjusting individuals 
mentioned previously. The first group consisted of the 25 recruits se- 
lected by psychiatrists as requiring further study not involving intellectual 
level OT literacy. The mean age of this group was 23,1 years with a 
standard deviation of 6,24 years. The secorrd group consisted of the 
23 recniitg selected by psychiatrists aa requiring examination concerning 
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poaBible mental deficiency or illiteracy. The mean age of this group was 
26.6 years with a standard deviation of 5.76 years. The third group 
consisted of those 114 cases who were given inaptitude discharges. The 
mean age of this group was 25.7 years and the mean school grade com- 
pleted was 8.8. 

Distributions of the number of items liked by these different groups 
are presented in Table 4. Two different groups of normal recruits ore 
presented for comparative purposes. 

Table 4 


DistributioiiB of Number of Likes Obtamed with Printed list for Various 
Groups of Normal and Noa'Adjusting Hecruila 


No. of 
Items 
Liked 

Screeued for 
other than 
M.A. or 
Reading 

Screened for 
M.A. or 
Reading 

Aptitude 

Discharges 

Normal 
Recruits not 
Screened 

Normals _ 
Matched with 
Aptitude 
Disohargea 

Freq, 

Cum. 

% 

Freq. 

Cum. 

% 

Freq. 

Gum. 

% 

Freq. 

Cum. 

% 

Freq. 

Cum, 

% 

22 



2 

100 

1 

100 

46 

100 

6 

100 

21 





2 

98 

34 

04 

3 

04 

20 

1 

100 



2 

97 

46 

89 

4 

92 

10 

1 

90 

1 

02 

1 

95 

39 

83 

6 

88 

18 

2 

92 

1 

88 

2 

94 

64 

78 

11 

83 

17 

2 

84 

1 

82 

1 

93 

38 

69 

1 

74 

IQ 

1 

76 



2 

02 

45 

64 

0 

73 

Id 



2 

78 

2 

00 

42 

68 

4 

65 

14 



a 

70 

4 

88 

54 

52 

7 

61 

13 

2 

72 

1 

56 

3 

85 

38 

46 

4 

66 

12 

1 

64 

1 

62 

2 

82 

51 

39 

8 

52 

11 

4 

60 

1 

48 

2 

81 

47 

32 

11 

46 

10 

1 

44 

\ 

1 

44 

4 

80 

39 

20 

6 

35 

0 

2 

40 

4 

39 

7 

7S 

29 

21 

11 

29 

8 


32 

2 

22 

11 

70 

28 

17 

3 

21 

7 

2 

24 



11 

60 

32 

13 

7 

IS 

0 



1 

13 

10 

60 

16 

8 

6 

12 

6 

1 

16 

1 

8 

11 

41 

17 

6 

3 

8 

4 

2 

12 



14 

31 

17 

4 

3 

5 

3 

1 

4 

1 

4 

12 

ID 

7 

2 

3 

3 

2 

1 





10 

8 

4 

1 



Total 

25 


23 


114 


732 


114 
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The first group of 732 normal recruita includes all recruits for ^vhom 
ages were available and who were not selected by psychiatrists as needing 
further examination. The mean age of tliis group was 25,4 years with a 
standard deviation of 4.0 yearfl. The second group of normal controls 
consisted of 114 recruits selected from the larger control group and 
matched with the 114 discharged cases on the basis of nge, highest grade 
completed, and age at leaving scliool The cfTcctivcncss of this matching 
is revealed by comparing the mean age of 25.1) of this normal group and 
their moan grade attainment of 8.8 witli the similar figures just presented 
for the 114 discharged recruits. 

Compariaons of the distributions indicate that, with education and age 
constant, the non-adjusting individuals and the normals tire differentiated 
by their ranges of interests as measured by this list. When a group of 
indivicluala ia tested and then from this group, people aye selected by 
psychiatrists as requiring further examination, this selected gioup will 
have restneted ranges of intcre>st9. Similarly, when a group, already 
studied by psychiatrists and psychologists and found to have an unfavor- 
able prognosis, is tested, people in this group will also have restricted 
ranges of interests. 

The mean scores of the two matched groups were compared, The 
mean score of the 114 normal cases was 12,8 with r standard deviation of 
5.2, The mean score of the 114 discharged cases was 0.9 with a atandard 
deviation of 5.0. The critical ratio of the difference between these two 
means, based on tlie atandard error of the difference and taking into ac- 
count the low but positive correlation between the groups, was 9.7. 
Beyond all doubt the scale differentiates between the two groups* 

In the discharged group, 50 per cent liked six or fewer itema,whUe in 
the normal group, only 12 per cent liked 6 or fewer items. In the normal 
group, 35 per cent liked more than 15 items while in the discharged group 
only 10 per cent like as many items. The relatively small amount of 
overlapping indicates the list measures a trait which clearly differentiates 
those people who have adjusted to military training and those who have 
not and this trait can be measured with sufficient exactitude to be useful 
in individual cases. 


Conclusion 

The preliminary work with the orally presented list and the later work 
with the printed list show that the range of intereats off era an indirect 
and convenient method for piedieting ndiustment to military training. 
The results show more overlapping between groups with the printed list 
than with the oral list. The more careful control of age and educational 
factors obtained in the analysis of the printed list, however, must be 
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considered. This and the greater convenience and objectivity of the 
printed list give it added advantage. 

The method can be uaeful in several situations. Firat it may be used 
as a screening device. As it does not select mental defectives and perhaps 
many other groups aimed nt in psychiatric screening, the list is in itself 
not a sufficient screening technique. Hunt, Wittson and Harris * have 
concluded that screen tests are most useful to the military psychiatrist in 
supplementing the results of his clinical interview. Moat acceptable is 
their suggestion that screening tests, such as developed here, and the 
psychiatric interview are best used to complement each other. 

The method is also useful in the collection of information to be used in 
making the final judgment as to whether a recruit should be retained in 
military service or not. The validity of these judgments is dependent 
upon the reliability, the relevancy and the amount of information upon 
which they are baaed. 

The analysis leaves little question that groups not adjusting well to 
military training tend to have significantly restricted ranges of interests 
and this restriction can be measured reliably in individual cases and used 
in making prognostic judgments. 

Rcceivtd My 17, IBU- 

* Himtj W. A., Wittson, C. L., and Harris, H. L The screen test in miiitary selection. 
Piyduil. Bee., 1944, 51, 37-40. 



A Note on the Problem of Brain Damage in Rehabilitation 
and Personnel Work 

Howard F. Hunt 
Vniversity oj Mimmla 

Brain injury in the adult human being is usually followed by altera- 
tions in personality and intellectual ability os well os by alterations in 
physical status. The symptomatology and vocational implication of 
these alterations deserves discussion since many returning brain-injured 
veterans will be only partially incapacitated and will desire some means 
of self-support. Tlie question of the employability of brain-injured 
persons is an important one at the present time, moreover, since this 
condition is not too uncommon among the general population as a result 
of accidents, disease, and excessive use of alcohol. This diaoiission is 
intended to provide personnel and rehabilitation workers who have not 
specialized in clinical psychology with useful information for dealing with 
brain damage cases . Only the psychologic symptoms of greatest practical 
import from the standpoint of vocational guidance aixd personnel work will 
be discussed here. No attempt will be made to discus, s the "basic, under- 
lying defect, or defects" of which these more or less superficial symptoraa 
are a function. 

The residuals of brain injury may, for purposes of convenience, be 
classified under two headings: primarily physical or somatic symptoms 
and symptoms which are primarily behavioral or psychologic- Among 
the more important physical symptoms are included: weakness and fa- 
tigability, convulsive disorders, sensory and motor disorders (including 
the aphasias), and defects in muscular coordination. These symptoms 
are generally detectable by routine physical and neurological examinations 
and from the medical history obtained from such a person. With the 
possible exception of the aphasias, the somatic disabilities usimlly come 
within the purview of the physician and will not be discussed here. 

The psychclogical symptoms consist superficially of intellectual de- 
terioration and alterations in the individual’s emotional life and per- 
sonality. The severity of the symptoms depends largely upon the 
severity and extent of the damage incurred and upon the prior peraonality 
organization and intellectual level of the affected individual, vaiying 
quantitatively from exceedingly subtle alterations in persons who super- 
ficially seem quite normal to gross dementia with disorientation as to 
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time^ place and even person. In aome cases both the paychologic and 
gomatic symptoms may be present in varied degrees and combinationsj 
while in other coses either the psychologic or the somatic symptoms alone 
may be appreciable. Even relatively small areas of damage in certain 
locations may produce distinct physical symptoms but little or almost no 
psychologic alteration, whereas lesions placed in other arcus of the brain 
may result in behavioral defects unaccompanied by appreciable somatic 
abnormality, Wc are primarily concerned with the latter type of case 
in this discussion. 

The intellectual deterioration or loss of intellectual ability resulting 
from brain damage apparently involves those more dynamic aspects of 
intelligence which are crucial for problem solving. Braindamaged per- 
sona commonly show some loss of memory for recent events^ a symptom 
which ia related to their decreased ability to learn unfamiliar material 
or new tasks. They also show rigidity and perseveration in their mode 
of attack on new problems and in their behavior in general. This defect is 
manifested in their decreased ability to organize or synthesize new be- 
havior patterns and in their tendency to continue to apply old, familiar 
methods of solution to new problems even after the method has proved 
unsuccessful. This characteristic may appear in social situations in the 
guise of decreased ability to follow rapid shifts in the form and content of 
conversations and diminialied skill in coping with sudden turns of events, 
In addition to tliese symptoms, a general slowing of thinking and speed 
of reaction as well as an increased distractibility are often observed. 
In general the old, familiar response patterns, habits, and skills are rela- 
tively unaffected by mild to moderate degrees of brain damage. 

Alterations in the individuaVs emotionality and, consequently, in 
personality frequently follow brain damage. Emotional reactions tend 
to be more easily aroused and to greater heights in the brain-damaged 
person than in the normal person, and they tend to abate more rapidly 
once aroused. Thus, these people often give the impression of a relative 
lack of inhibition or emotional control as well as of deficient foresight 
and concern about their own future or the consequences of their acts. 
Many show a mild degree of perhaps unjustified optimism and buoyancy 
or euphoria, while aome others may show a tendency toward an exaggera- 
tion of their previous personality characteriatica. These symptoms, plus 
the accompanying intellectual changes, set the stage for childish or anti- 
social and unethical behavior in predisposed persons. In general, the 
individual's power of adjustment to society and to the problems of every- 
day life is diminished. 

No specific personality ^*type^^ seems to be invariably peculiar to or 
characteristic of brain-damaged persons. In the case of adults, the de- 
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fecta described above ere imposed on a matured peraonality ''gystem*^ or 
structure. The resultant behavior characteristics will thus bo a product 
of the interaction between the individual's original personality and inteh 
lectual level and the specific residuals associated with brain damage, plus 
the frequently exaggerated reactions of this modified personality to the 
stresses and strains incidental to the demands of daily life. This latter 
factor may be particularly important in some cases since the brain- 
injured person's goals and expectations may remain relatively unaltered 
though his capacity for achieving them is reduced- Thus, a person whoso 
powers of adaptation and emotional control are diminished must often 
live under and adjust to particularly trying circumstances. It is not 
surprising that some braia-injured persons develop psychoneuroses or 
exhibit socially unacceptable behavior. Seneori-motor and speech de- 
fects or convulaive disorders may also complicate this situation, as may 
paychoneurotio reactions on the part of the affected person to the idea of 
being handicapped or to tho circumstances associated with a spectacular, 
injury-producing accident or illness. 

Because there is no regeneration of destroyed neuronal tissue within the 
brain, the permanence of the detects associated with brain damage has 
sometimes been assumed. Partial and sometimes almost complete clini- 
cal recovery does occur in some coses, however; but in which cases it will 
occur cannot yet be predicted accurately, Recovery, if it is to occur to 
an appreciable degree, is usually well under way within a period of a few 
months after injury and is not generally to be expected in cases of long 
standing deterioration. 

This discussion has been primarily concerned with the symptoms of 
cases in which brain damage occurs after the individual has attained 
almost full intellectual growth, that is after the person is fifteen or sixteen 
years old, The defects resulting from damage earlier in life are somewhat 
similar with additional complications arising from arrested or uneven in- 
tellectual and personality development; consequently defective education, 
often with marked and specific deficiencies in one or more of the tool 
subjects such as arithmetic or reading; and the development of various 
compensatory habits and unacceptable reaction patterns. Probably only 
the less severely affected cases of this type will be encountered in the 
employment situation since, in most cases, the segregating and selecting 
iafluences of achool and Boevety have elimmatcd the grossly unfit from 
the active labor market. 

The vocational prognosis attached to brain-damaged persons depends 
upon a number of factors. The severity of the handicap in such persona 
ifl relative to their original intellectual level and personality. It depends 
not only upon the extent and placement of the damage and upon the 
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absolute magnitude of the intellectual and emotional alterations but also 
upon the individuars original intellectual ability, education and training, 
and the excellence of hia personality integration and adjustment. The 
magnitude of the handicap is also relative'^to the type of work he wishes to 
perform and to hia interest in and familiarity with it. 

The exact vocational implication of mild to moderate psychologic 
defect following brain damage is as yet unknown, but a few generalizations 
may be drawn from our relatively limited cUnical experience with it and 
on the basis of the symptoms of the condition. Occupations placing a 
premium on physical stamina, inventiveness and ingenuity, emotional 
control, and diplomacy in inter-personal relations are probably contra- 
indicated in the majority of cases just as are positions involving great 
personal responsibility both for the welfare of other persons and for vital 
programs or equipment. Special experience and training or ability and 
good personal adjustment coupled with relatively minimal intellectual 
and emotional changes, however, would warrant exception to the above 
generalizations in some cases. Usually, nevertheless, even mild psy- 
chologic defect is probably an unfavorable prognostic sign with regard to 
both vocational and personal adjustment. 

Though diagnosis and treatment of brain damage are primarily 
medical problems, the standard techniques utilized by physicians fail to 
yield certain types of information crucial to the vocational management of 
affected persons. Medical facilities for detecting and estimating the 
severity of the psychologic symptoms associated with brain damage con- 
sist largely of unrefined, uncalibrated tests aided by subjective, clinical 
impressions and estimates. These techniques yield relatively unreliable 
estimates of degree of deterioration. Also, since they are relatively 
insensitive, they may fail to detect minimal defects, especially in cages 
where the physical symptoms are not appreciable. In a few cases, more- 
over, the physical and neurologic examination findings may be entirely 
negative, the psychologic defects minimal, and the brain damage detect- 
able only by refined psychometric methods. Recent advances in clinical 
psychology have provided more adequate and more sensitive methods. 
Though these methods do not ''measure'^ in the strictest mathematical 
sense, they represent a marked improvement over the traditional medical 
techniques in that they are somewhat more sensitive and do yield rough 
eatimatea of degree of deterioration. They are particularly useful in 
evaluating the employable brain-damage cases — those with relatively 
minimal defect. 

Clinical psychology has, however, no special technique to offer for the 
detection of minimal alterations in the emotionality of brain-damaged 
persona. The standard personality tests are of considerable value in 
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assessing the actual personality characteristics of these people, neverthe- 
less. A personality deviation in a brain-damaged person may have more 
serious implications than a similar deviation in a person who is intact* 

To be of practical value in the perBonnel or vocational guidance situa- 
tion, a psychometric instrument must not require extended administration 
time or extensive, cumbersome equipment, and yet it must be maximally 
sensitive. Ease of administration and scoring ns well as interpretability 
are also crucial. Of course, the test must have clinical validity and be 
applicable to the type of person being tested, applicable both from the 
standpoint of its content and from the standpoint of its standardization. 
As is well known, however, the use of teats provides no royal road to 
diagnosis. The pitfalls for the unwary are many, and the thoughtless 
clinician all too easily may be lulled into a false sense of security by the 
arithmetic form and so-called ^'objectivity” of teat results. A teat is uo 
better than the clinician who usea it, and an otherwise useful teat may he 
rendered ineffective by thoughtless, careless administration and naive 
interpretation. The examiner must be thoroughly familiar with the ad- 
ministration technique as well as fully cognizant of the psychologic aspects 
of the task and total situation with which the te.sted person is confronted. 
This is particularly important in brain-damaged cases because of their 
characteristic emotionality and psychologic defects. Naturally, test re- 
sults must be considered as but a part of the evidence required for diag- 
nosis and must always be interpreted in the light of all the rest of the data 
relevant to the cose being studied. 

The standard intelligence teats have often been used to detect intel- 
lectual deterioration, but; they are somewhat ineffective tools for this 
purpose from the strict psychometric standpoint because of their relative 
insensitivity to this condition. They may, however, provide the occasion 
for behavior of great diagnostic significance to an experienced clinical 
psychologist. In general, the same evaluation applies to the Rorachach 
(ink blot) method when used as a deterioration test. Moreover, much 
specialized experience and training are required for proper administration, 
scoring, and interpretation of this procedure. Accordingly, the use of 
psychometric instruments specially designed for the detection of deteriora- 
tion is advised, particularly in borderline cases. 

A number of deterioration testa have been developed, but the more 
effective of such tests have been based upon what might be called the 
differentialscoretechnique which was originally suggested by Babcock (1). 
This technique involves measuring the discrepancy between a person's 
performance on teats sensitive to brain damage (tests of learning, memory, 
abstract thinking) and his performance on tests relatively insensitive to 
this condition (testa of vocabulary, information). Significant discrepan- 
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cics indicating impaired performance on the sensitive teats relative to 
pei’formance on tlie insensitive teats would thus suggest brain damage. 
This neat situation is complicated, however, by the tendency of depressed, 
anxiouSp schizophrenic, and other varieties of disturbed persons to obtain 
similarly discrepant scores on the two types of tests. Thus, such patho- 
logic discrepancies, or deterioration scores, are ambiguous diagnostically 
and should be confirmed by case history and neurologic examination data 
before anything stronger than a suspicion of brain damage is justified. 

In cases with pathologic deterioration test scores, differentiation as to 
the etiology of the score is important from the standpoint of long-time 
vocational prognosis. Pathologic scores attributable to emotional- 
motivational disturbances as in the depressions and the anxiety states 
indicate an impairment of intellectual efficiency which usually disappears 
when the afflicted individuals recover. Schizophrenic deterioration gen- 
erally disappears in a like manner in those cases which do recover. In 
contrast, the intellectual impairment associated with brain damage is 
usually considerably less transient and is accompanied, therefore, by a less 
favorable vocational prognosis. Because of the proneness of brain- 
damaged persons to emotional disturbances, the more permanent impair- 
ment aisociated with the brain damage may be temporarily augmented by 
depression, anxiety, and the like. Under these conditions, the ultimate 
intellectual status of the person is difficult to determine since some of the 
impairment indicated by the test score may be expected, in many cases, 
to disappear ivhen emotiona] equilibrium is regained. 

Deterioration test scores are thus not a final index of vocational prog- 
nosis but rather a diagnostic and prognostic aid. The extent to which 
they aid diagnosis and prognosis depends to a substantial degree upon 
the skill and clinical acuity of the interpreting clinician. 

Of the ayailable, specially deviaed deterioration tests for adults, the 
Shipley-Hartford Deterioration Test (8) is the easiest to administer. It 
is a twenty minute, self-administering, paper and pencil test which may 
be used only with cooperative, test-sophisticated subjects of average or 
above average intelligence. 

The Babcock-Levy Revised Test for Efficiency of Mental Functioning 
(2) is an individual test very similar to the standard individual intelligence 
teats in the time, skill, and amount of equipment required for administra- 
tion. It is applicable to cooperative persona of a somewhat less restricted 
range of intelligence and test-sophistication than is the Shipley. The 
norma for these two teats include no correction for normal deterioration 
with advanced age, so subjective correction for this factor must be made 
in the interpretation of the teat performances of older persons. 

The Hunt-Minnesota Teat for Organic Brain Damage (4) is an indi- 
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vidual teat requiring Gome practice but relatively little equipment for 
administration. The test can be completed in from fifteen to thirty five 
minuteSj depending upon whether the short or the long form ia used. 
It is applicable to cooperative adults with mental ages of over eight years, 
and the norms include a statistical correction fbr normal age changes 
within the range of sixteen to seventy years. Scores on this teat obtained 
from persons near tlie extremes of the age and intelligence ranges must be 
interpreted with considerable caution, however. 

“Psychological deficit^* has been suggested (6) as an inclusive but 
neutral term for the impairment of intellectual efficiency associated both 
with brain damage and with emotional-motivational disorders. The 
three tests described above are apparently fairly effective in detecting 
this deficit. In the development of the Hunt test, an attempt was made 
to provide a special means for identifying those pathologic scores attribut- 
able to emotional-motivational disturbancea bo that the teat would then be 
a specific test for the deterioration associated with brain damage. This 
attempt has been only partially successful. Since neither the Shipley 
nor the Babcock tests make this discrimination, pathologic scores on any 
of these three tests may indicate either brain damage or an emotional- 
motivational disturbance accompanied by poor cooperation, motivation, 
and attention, Consequently, great care must be exercised in the inter- 
pretation of scores obtained on these teats. 

Received July 18, I944r 
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Persopality Patterns of Adolescent Girls : 

II. Delinquents and Non-Delinquents 

Dora P. Capwell 

Trainee Acceplarue Center, Public iSchoob, PiOsburffh, Fa. 

Iq a study devoted to the peisonality patterns of adolescent giiis who 
show impiovement in IQ (2) two groups of girls were used ns subjects, a 
group of delinquents and a group of non-delinquents. A series of per- 
sonality teats were administered to each group on two occasions along 
with teats of intelligence and academic achievement. The results of the 
personality teats, aside from their contribution to the original problem, 
are of special interest due to the degree and manner in wliioh they differ- 
entiated the delinquents from the non-delinquents, Most present day 
students of delinquency agree with the point of view expressed by Lowrey 
(10) . “Delinquency is probably most frequently due to the subtle effects 
of interactions between individual and environment, leading to the es- 
tablishment of particular personality sets.” However, there has been 
disagreement regarding the success with which one can measure and 
delineate these personality sets by means of standard, objective testa of 
personality. The following results show the differences of personality 
between a group of delinquent girls and a group of non-delinquent girls 
as measured by one series of personality teats. 

The procedure has been described in detail in a previous report (2). 
A total of 101 delinquent girls at the Minnesota State School for Girls and 
85 non-delinquents in the Public Schools of Sauk Centre, Minn., were 
given a psychological examination and re-examined from 4 to 16 months 
later, The personality tests which were given twice were the Minnesota 
Multiphasic Personality Inventory (6), the Washburne Social Adjustment 
Inventory (13) and the Preasey Interest-Attitude Test (11), Two other 
tests of personality, the Terman-Miles Test of Masculinity-Feminity (12) 
and the Vineland Social Maturity Scale (3), were given just once. The 
levels of intelligence and academic achievement were determined by the 
Kuhlmann Teats of Mental Development (9) and the Stanford Achieve- 
ment Test (8). 

Eesults 

Before examining the personality test results, it is important to note 
the differences between the two groups in intelligence and achievement. 

230 
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The non-delinquents were girls of higher intelligence^ showing a mean IQ 
on the first test of 101, as compared with a mean of 87 for the delinquents. 
The standard deviation for each group was 17. Each group showed some 
retardation in school achievement when compared with the norms of the 
Stanford Achievement Test. The delinquents were more retarded than 
the non-delinquentSj as would be expected, but the differences are not 
statistically reliable. The amount of retardation in terms of grade scores 
is shown in Table L 

Table 1 


Difference between Actual Grade Level and Achievement Grade Score * 


Score 

Delinquents 

N = 97** 

Non-Delinquents 

AT 85 

li/ffD 

between 

Delinquents 

Mean Diff. 

S.D. 

Mean Diff, 

S.D. 

Delinquents 

Total Score 

-uo 

1.41 

-.82 

1.50 

2.28 

Heading Score 

-.55 

1.52 

-.49 

1.40 

.28 

Arithmetic Score 

-1.06 

1,70 

-1.28 

2.03 

2.42 


*1.00 equals one total grade. 

** Four delinquents were absent when these teats were given. 


The peraonality teats diacTiminated the delinquents from the non- 
delinquents with varying success; two of them showed striking differences, 
The significance of differences between the two groups on the Minnesota 
Multiphaaic Peraonality Inventory ia shown in Table 2. 


Table 2 

Minnesota Multiphaaic Personality Inventory — Significance of Difference of Raw Scores 


Scale 

Difference between Delinquents and Non-Delinquenta 

PiratTest 

D/<rD 

Second Teat 

D/trD 

U'^ll 

2:93 

4.25 

L 

1.76 

3,30 

P 

7.21 

5.95 

He 

3.11 

3.12 

D 

4,60 

2.02 

Hy 

2.74 

,00 

Pd 

16.00 

14.00 

Pa 

12.00 

8.03 

Pfc 

6.64 

7.30 

So 

7.10 

8.56 

Md. 

B.00 

7.95 
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Each scale except the Hy, or Hysteria scale, shows a clear differentia- 
tion between the two groups. The greatest difference appeal’s in the 
scores for Pd (Psychopathic Deviate). The extent to which the Multi- 
phaaic differentiated the groups may be seen in Table 3, and Figures 1 
and 2 show graphically the differences in average T-scorea between the 
two groups. 


MULTIPHflSIC SCaifS 



Pig. 1, T-acoro profile on the Multiphasic Inventory for the Delinquent (D) 
and N'on-Delinquent (N) groups, let test, 


MULTIPH/lSfC SCALE’S 



Fiq. 2. T- 3 Coro profile on the Multiphaaic Inventory for the Delinquent (D) 
and Non-Delinquent (N) groups, 2nd test. 


Table 4 shows the significance of differences between the raw scores 
of the other personality tests. The Washburne and the Vineland differ- 
entiated between the delinquents and non-delinquents, but the Pressey 
Interest-Attitude and the Terraan-Miles did not. On the TVashburne 
54% of the delinquents reached or exceeded the 75th percentile of the 
non-delinquents' scores on the first examination, and 51% did bo on the 
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Tabic 3 


PGrcontago of Ovorkp on tho Mulfciphiiaic 


MuUipLasic Scale 

Percentage of DoUnqiicnta who Reached or Exceeded 
tho 75th Pcrcentilo of Non-Dclinquonts 

lat Teat 

2nd Teat 

Hb 

41% 

48% 

D 

48% 

37% 

Hy 

32% 

10% 

Pd 

03% 

92% 

Pa 

84% 

05% 

Pi 

61% 

01% 

Sc 

64% 

71% 

Ma 

84% 

71% 


second examination. The Vineland showed differences in the other direc- 
tion, in that on the other personality tests a high score tends toward 
maladjustment^ while on the social maturity scale a high score is a favor- 
able one. On the social maturity scale only 31% of the delinquents 
reached or exceeded the median of the non-delinquents. 

Table 4 


Other Personality Testa-^Significance of Difference of Raw Scores 


Teat 

Teat No, 

Difforcnco between 
Delinquonta and 
Non-DGlinqucntfl 
D/trD 

Washburne 

Isfc 

6.31 

Woahburne 

2iid 

4.54 

Preasoy 

1st 

.62 

Pressey 

2n(l 

.01 

Terman-Milea 

(one only) 

.80 

Vineland * 

(ono only) 

3.06 


* D/crD between social quotients. 


Inasmuch as the two groups which were differentiated by the MuJti- 
phosic, the Washburnc, and the Vineland differ in level of intelligence as 
well as in regard to delinquency, it is necessary to find out if the personality 
test differences are related to the differences in intelligence. Hence, 62 
delinquents from the group were matched within two IQ points with 52 
of the non-delinquents in order to compare personality differences and 
percentage of overlap on those tests which differentiated the groups re- 
liably. The mean IQ of each group was 95 with a standard deviation of 
14. Only those testa were compared which differentiated the larger 
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groups- Hesulta obtained with the matched groups may be seen in 
Table 5. 

The MultiphaBic continued to differentiate the delinquents and non- 
delinquents reliably with the exception of the Ha scale. Hy was not used 
because it did not differentiate the larger groups. The Washburne fell 


Tabic 5 

Matched Greupa of Delinquonta and Non-Delinquenlfl: Significance of Difference of 
Haw Scores on First Examination and Porcentago of Overlap 


Test 

D/aD 

Percentage of Delinqiienta who 
Hcached or Exceeded 75th 
Percentile of Non-Dclinqueuta 

Multi phasic 



Hfl 

l.OB 

— 

D 

3.91 

56% 

Pel 

10.34 

93% 

Pa 

8.43 

84% 

Pfc 

4.86 

67% 

Sc 

4.00 

67% 

Ma 

B.22 

63% 

Woahburno 

2.70 

50% 

Vineland 

.38 

— 


slightly below satisfactory reliability of differences, and the Vineland 
failed to demonstrate any real difference when the groups were matched 
for IQ. Hence, the differences on the Vineland appear to be related more 
to intelligence than to delinquency, but the differences on the Washburne 
and the Multiphasic continue to be aignificaut. 

Diacusaion 

The test which differentiated most clearly between these two groups 
was the Multiphujsic, The resuJtg, which include the three validating 
scores j show first of all that oven quite young adolescents do answer a well- 
devised peraonaiity inventory validly. The mean validity scores arc 
close to a T-score of 50 for all groups, except for the delinquent scores on 
the F-acale; these were higher, but not sufficiently so as to invalidate the 
results, They would be expected to be somewhat higher than the F-scoi*es 
for the non -delinquents because of the much greater amount of maladjust- 
ment in the delinquent group, and since, aa stated before, there is a slight 
tendency for the F-score to be higher as gross maladjustment increases. 
The non-delinquenta had many more responses than the delinquents, 
due probably to two factors: first, they were a slightly younger group and 
found more items they did not understand, and secondly, the delinquents 
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had more leisure at the time of taking the teats. On the whole, however, 
the results from both groups showed a reassuring degree of validity. 

It has long been believed that delinquents are more generally unstable 
than the normal population, and the Multiphasic Inventory bore out this 
belief by showing a significant difference of mean scores between delin- 
quents and non-delinquents on seven of the eight scales, the delinquents 
scoring further away from the mean for the normal population, Even 
when the scores were not equivalent to a T-score of 70 or over, the criterion 
for significant maladjustment, they still were further toward the malad- 
justment end of the scale than were the scores of the non-delinquents. 
The moat conspicuous differences were on the scales of Psychopathic 
Deviate and Paranoia. The delinquents had a mean T-score of 73 on 
the Pd scale and 65 on the Pa ecale. 

The delinquents were not as depressed as one would imagine, on their 
arrival at a correctional institution. That they are not is a finding which 
i^ conaiatent with the theory of the paychopatliic deviate set forth by 
Hathaway (6), suggesting that the psychopathic inferior or deviate has 
trouble in his relations to society partly because he does not react with 
the emotions with which the normal person reacts under similar circum- 
stances. Therefore, although the newly committed delinquent may seem 
to feel very badly, cry noisily, and appear to be extremely depressed, the 
test scores and also the speed with which she often recovers from this mood, 
attest to the belief that it is a relatively superficial emotion. In the 
non-delinquent group only two girls made scores on the Pd scale as high 
as the mean for the delinquent group. Of these two one was a girl so 
maladjusted that she was being considered for foster-home placement by 
the child welfare worker of the county, and the other was a girl who had 
left school for a time, returned of her oAvn volition, but was again con- 
sidering leaving and was so upset that she was of concern to the school 
principal; she herself asked for a conference with the examiner to talk 
^bout her difficulties. Thus, this test measures adjustment in the same 
sense in which non-delinquents are better adjusted than delinquents. 

Two other personality tests, the Presaey Interest- Attitude Test and 
the Terman-Miles Test of Masculinity-Femininity, when their raw scores 
were compared as with the other tests, did not discriminate between the 
delinquents and non-delinquents. This ia contrary to the results implied 
by the report of Durea and Fertman (5), who gave the Pressey to 180 
delinquent girls. Their study merely showed, however, that the scores 
from the delinquents eompare ‘‘unfavorably with norma for nou-delin- 
quents/' No control group was used at the same time. In the present 
data the delinquents compare unfavorably with the norms, but so does 
this particular sample of normal cases. These same normal girls made 
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normally expected scores on the other tests. The Preaaey apparently does 
not measure the type of adjustment measured by the Multiphasic or the 
Wftshburne. The Torman-Milea did not show significant differences 
between the groups, but each group contained some cases of extreme 
scores, as one may judge from the standard deviation of the groups. The 
deviate cases were not always the girla who tested as most maladjusted 
on other teats. 

The Vineland Social Maturity Scale did not show aa much difference 
in social maturity aa might be expected between the delinquents and 
non-delinquents. These girls do not show as much social retardation as 
the delinquent boys reported by Doll and Fitch (4), but there are other 
marked differences between the boys they studied and the girla of this 
study, the most important one being that the boys were much more 
retarded mentally than the girls are, The median mental age for the boya 
was 9.3 years, as against a median life age of 14 years. The social 
quotients were nearer the mental ages than the life ages, In the present 
group of delinquent girls the mean social quotient is 4 points below the 
mean IQ and is more related to intelligence level than delinquency. 

In concluding the discussion of these test results a word may be said 
about the use of personality teats aa measures of adjustment both with 
groups and individuals. Whether or not one considers them valid and 
helpful instruments to aid diagnosis appears to depend largely on the 
selection of tests one uses. Boynton* and Walaworth (1) used six tests, 
all different from the ones used in the present study, with 47 delinquent 
and £0 normal girls and found that only one score of one test yielded a 
C.R. of 3.00 between the groups. They concluded that the testa ^hn the 
main do not provide empirical evidence of sufficient validity to justify 
one in putting a great deal of faith in them in individual and group 
diagnosis.*' They concluded further that since there was such disparity 
between the teat results, delinquent behavior is not necessarily associated 
with personality aberrations. Somewhat different conclusions are war- 
ranted from the results of tests used in the present study. Two of them, 
the Terman-Miles M,-F. Test and the Pressey Interest-Attitude Test, 
were not helpful in differentiating delinquents and non-delinquents. Two 
others, however, gave satisfactory differences and should be helpful in 
either individual or group diagnosis ; these two were the Minnesota Multi- 
phasic Personality Inventory and the Waahburne Social Adjustment 
Inventory, The results of both suggest that personality aberrations 
frequently are associated with delinquency. The use of personality tests 
with any special group necessitates careful selection of teats on the basis 
of the way they were standardized aa well aa their suitability for providing 
the desired information. Beyond that, experience with the results in 
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the particular group concerned is necessary before a fair evaluation can be 
made of the usefulness of the test. Generalization from a selected group 
of personality tests to all tests of that type is not warranted any more 
than from one intelligence test to another. 

Summary and Conclusions 

A group of 101 delinquent and 85 non-delinquent girls were tested with 
a batteiy of personality teats and retested from 4 to 15 months Utev. 
Differentiation between the two groups was measured by computing the 
significance of difference of the mean scores for each group and also the 
percentage of overlap. The groups differed in level of intelligence as well 
as in delinquent tendencies, so the effect of mental level on the personality 
test scores was investigated by similar statistical treatment of the scores 
of 52 girls from each gi-oup who were matched for IQ. The results led 
to the following conclusions: 

1. The Minnesota Multiphasic Personality Inventory and the Wash- 
burne S.-A. Inventory discriminated the delinquents from the non- 
delinquents in degree of personality adjustment. 

2. The Vineland Social Maturity Scale showed differences which were 
more related to intelligence than to delinqiiency. 

3. The Pressey Interest-Attitude Test and the Terman-Milcs Teat of 
Mascuhnity-Pemininity did not discriminate the delinquents and non- 
delinquents. 

4* Personality tests may be of value with individuals or groups in 
meaBuring and describing the pcraonality patterns of delinquent as 
distinguished from non-delinquent girls, 

Remv€d /ufifi IBH, 
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The Constniction of the Guilfor d-Martin 
Inventory of Factors G-A-M-I-N 

Howard G. Martin 
Lq 3 Angeles, California 

Factor analysis methods have been applied to the problem of isolating 
independent variables of temperament with the result that several unitary 
traits have been identi&ed (3, 4, 5) and a aeries of inventories constructed 
which attempt to measure some of these traits (1, 6). 

The Guilford-Mai’tin Inventory of Factors G-A-M-I-N adds five 
more temperament variables to the eight already covered by the two 
preceding testa of the series. The five traits included in the new inventory 
are: G, General pressure for overt activity; A, Ascendancy in sociol 
situations as opposed to subiniasiveness; leadership qualities; M, Mas- 
culinity of attitudes and interests aa opposed to femininity; I, Lack of 
inferiority feelings; self-confidence; and N, Lack of nervous tenseness and 
irritability. 

Traits G, M, and N were discovered in factor analyses by Guilford 
and Guilford (3, 5) and trait I by Hosier (7). Traits A, M, I, and N 
have been recognized by clinical psychologists, though not always defined 
in the same manner. The definitions of the trait names as used in this 
connection are operational; that isj in terms of factorial studies and 
subsequent item analyses, 

More than 300 questionnaire items were constructed which were be- 
lieved to cover the areas of behavior constituting tliese five traits. This 
list, stated in. question form to be answered by either “Yes," “7," or 
"No," was administered to 250 men and 250 women college students 
between the ages of 19 and 30, ranging from sophomores to seniors in 
southern California colleges and universities. 

The items which had been shown by the factor analyses and two pre- 
vious item analyses to have heavy loadings in a trait were included in the 
preliminary scoring key for that trait. Typical items from these keys are 
listed below: 

Por trait G: 

Are you inclined to be quick in your actions? 

Can you turn out a large amount of work in a short time? 

A.re you inclined to rush from one activity to another without pausing 
for rest? 
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For trait A: 

Do you usually speak out in a meeting to oppose someone who you feel 
sure is wrong? 

Do you find it difficult to get rid of a salesman to whom yon do not caro 
to listen or give your time? 

Have you ever, on your own initiative, organized a club or group of any 
kind? 

For trait M 

Do you like love scenes in a movie or a play? 

Do you (or would you) like to go hunting with a rifle for wild game? 

Are you disgusted at the sound of foul language? 

For trait 1: 

Do you feel that the average peraon has made a better adjustment to life 
than you have? 

Do you feel confident that you can cope with most situations that you 
will meet in the future? 

Do you suffer keenly from feelings of inferiority? 

For trait N i 

Do you often become irritated over little annoyances? 

Do you have nervous habits such as chewing your pencil or biting your 
fingernails? 

Do you feel compelled to change your bodily posture frequently while 
sitting? 

Pour hundred of the questionnaires (200 males and 200 females) were 
scored with the preliminory scoring keys thus constructed. Tlie highest 
loo and the lowest 100 cases (extreme quarters of the distributions of 
scores) were used as criterion groups in the item analyses for factors G, A, 
I, and N. For the item analysis of factor M, the criterion groups con- 
sisted of the 100 male cases highest on the preliminary scoring key for the 
M factor and the 100 female cases lowest on the key. 

Scoring weights were found for each response to each item by using 
Guilford's abac method (2). This procedure yielded final scoring keys 
consisting of 41 items for trait G, 50 items for trait A, 52 items for trait M, 
64 items for trait I, and 68 items for trait N. Only nine items were scored 
for more than one trait. 


Table 1 

Intercorrelationa between Scores of 100 Cases 



G 

A 

M 

I 

A 

,61 




M 

.10 

.34 



I 

,30 

,64 

,43 


N 

-.27 

.10 

,34 

.70 


As a check on the reliability of scoring, the test papers of the remaining 
loo cases, including 50 males and 50 females, were scored with these final 
scoring keys, which, for the purpose, were divided into random halves 
of items. Pearaonian coefficients of correlation were computed between 
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the scores on these halves of the scoring keys and, when corrected by the 
Spearman-Brown formula, they became .89 for trait G, .88 for trait A, .85 
for trait M, ,91 for trait I, and .89 for trait N. 

Intercorrelations between the scores derived by means of these scoring 
keys are shown in Table 1. 

The validity of trait M was checked by comparing the distributiona 
on the trait scores of the 50 males and the 50 females which were not used 
in the item analyses. Ninety-two per cent (46 out of 50) of the males 
were above the median of the distribution of the 100 scores of the two 
sexes combined. Ninety-two per cent (46 out of 50) of the females were 
below the median of this distribution. The overlap was only 8 per cent 
of the 100 scores. Some males are more feminine in their reactions than 
some females and vice versa (8). That this difference in some oases may 
have a glandular condition accompanying it is demonstrated by the fact 
that one of the males who fell below the median on trait M was found to 
have a history of hypogonadal function and infantile genitalia. 

These types constitute an undetermined percentage of the overlap in 
scores between the sexes in general. Therefore, the validity coefficient 
(phi) of ,84 for trait M which was computed from these figures is as high 
as can he expected in view of the fallibility of the criterion. 

Rtceited July 28, 18^. 
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Measuring Progress in Radio Training 

Gordon 1. Macdonald 
New York Vniveriply 

In New York City the War Department in conjunction with the New 
York State Department of Education set up a school in 1942 to train radio 
technicians where the instruction was administered by various universities 
and radio schools. The course of instruction, lasting six months, was 
divided into two sections of three months each, It was within this edu- 
cational framework that the problem for this study evolved. 

This study grew out of the need for an adequate test to measure the 
progress of trainees under instruction. Specifically the problem is two- 
fold: (1) to develop an adequate instrument for measuring progress in 
training that would be valid and reliable at various levels; and (2) to apply 
the instrument to groups of trainees for the purpose of evaluating their 
progress and comparing results in the several institutions. 

This investigation included 1,166 subjects studying the theory and 
practice of radio servicing (how to repair radios). These subjects repre- 
sent three levels of general education: (I) High School Students, consisting 
of three groups of 28, 34 and 25 subjects between the ages of 16 and 20 
studying in a public vocational high school (These students were not in 
any way involved In the War Department training program and were 
included in this study for comparative purposes); (2) High School Gradu- 
ates, consisting of four adult groups of 126, 289, 326, and 216 students be- 
tween the ages of 18 and 40. This age limit was set by the War Depart- 
ment for radio trainees accepted for a course of study in a commercial 
radio school under the supervision of the War Department and the New 
York State Department of Education; and (3) College Students of which 
there were three groups of 25, 30, and 34, with a mean age of 20 years, 
studying at three universities in New York State where their courses were 
limited to three months. 

The subjects comprising the two educational levels of adult High 
School Graduates and College Students, who were trainees of the Signal 
Corps, War Department, were chosen on the basis of a Civil Service 
aptitude teat and a physical examination by aimy doctors, and they were 
further required to join the enlisted reserve of the Army of the United 
States. The group of College Students were further selected on the basis 
of their knowledge of higher mathematics and college physics. 
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There was no standardized objective ftchievement test in the field of 
radio available. However, an unstandardized test was discovered con- 
sisting of two forms, A and B, each containing 116 items and it was used 
and standardized in this investigation. It was a paper and pencil, mul- 
tiple choice, self administering, group achievement test with no time limit, 
but requiring from one hour and a half to over two hours for completion. 

The preliminary standardization was done at the level of High School 
Graduates of general education, and at two levels of specialized radio 
training. Group V with three months' training, and Group VII with six 
months^ training were used in this phase of the study. 

As a result of these analyses two new forms of the test, revised Form A 
and Form B, were prepared consisting of the best 09 items from the 116 
of each original form. It is these forms which were used in the rest of 
this investigation. 

Training Progress Measured 

The revised forma were administered to various groups at three dis- 
tinct levels of general education to find out if progress in specialized radio 
training could be measured equally well with the test regardless of back- 
ground, Norms in radio training thereby can be made available taking 
into account any contribution of general education. 

High School Students (Groups I, II, and III) : The sub jecta at this level 
of general education had completed the 2^ years of general instruction 
of a public vocational high school and were in attendance on one of the last 
three terms of specialized radio instruction. They were tested at the end 
of 315 hours of radio instruction, or one term (Group I), at the end of 630 
houia of radio instruction, or two terras (Group II), and at the end of 945 
hours of radio instruction, or graduation (Group III). Both Forms A 
and B, with some exceptions, were administered to all members of these 
groups. 

The means, sigmas of distribution, and C.R.'s between the means on 
both forma, for the three groups, are given in Table 1. 

The levels of specialized radio training are differentiated one from 
the other by both forms of the test as is indicated by the difference between 
the means; and these differences are significant as indicated by the critical 
ratios. 

High School Graduates (Groups IV, V, VI, and VII) : The adult radio 
trainees who comprised this level of general education were all high school 
graduates. The groups were divided according to specialized training in 
radio as follows: Group IV being novices with no training; Groups V and 
VI being students with three months^ full-time training of 624 hours; and 
Group VII having completed the six months' full-time course of training 
of 1,248 hours. 
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Table 1 

Progress in Specialized Radio Training at the General Educational Love! of High School 
Students, Showing M, a- (dist.), for Each Level, and G.R.’s between Levels 
of Specialized Training Separately for Forms K and B 


Form A 


Training Period 

Group 

Mean 

a- (diet.) 

N 

One term (316 Uoura) 

I 

43.00 

7.77 

28 

Two terms (030 hours) 

II 

49,80 

11.61 

34 

Three terms (045 hours) 

HI 

60.92 

10.62 

26 

Critical Ratios 

One term (316 houra) vs, two terms (030 hours) 


2.75 

Ono term (316 hours) va. three terms (046 hours) 


7.00 

Two terms (030 hours) va. three terms (046 hours) 


3.81 

Form B 

Training Period 

Group 

Mean 

<r (dist.) 

N 

One term (315 hours) 

I 

39.00 

5.70 

28 

Two ierma (630 houra) 

II 

40.00 

10.17 

34 

Three terms (945 hours) 

III 

61.05 

9.03 

25 


Critical Ratios 


One term (315 hours) vs. two torins (030 hours) 3.70 

One term (316 hours) vs. three terma (945 hours) 10,93 

Two terms (630 hours) vs. tlinee toiina (946 hours) 0,10 


The means, gigmaa of distribution, and C.R.^s between the means for 
aif groups on both forms are given in Table 2. 

It is evident from the means given in Table 2 that the three levels of 
specialized radio training of training,** '*three months* training,” and 
“six months* training** are distinguished one from the other. The critical 
ratios indicate that the differences between the means of the two groups 
with three months* training (Groups V and VI) are statistically insignifi- 
cant, while the differences between the means for the other levels of spe- 
cialized training are highly significant, these values holding for both forms 
of the test, 

The results with Form A (Table 2) show that the difference between 
the means of the two groups tested at the end of three months of spe- 
cialized radio training (Groups V and VI) is statistically insignificant, 
the C,R. being 1.36. The C.R. between the thi'ee months* tiaining level 
(Group V) and the six months* training level (Group VII) is 10.57, and 





304 


Gordon L. Macdonald 


the C.R* between the three months* training level (Group VI) and the six 
months* training level (Group VII) is 9.39. Thus Form A distinguishes 
clearly between levels of specialized training in radio among high school 
graduates. 

The results for Form B are similar. The novices, or those with no 
training (Group IV) are distinguished from the others quite significantly 
with C,R,*a of 14.08 and 14.74 in comparison with the two groups with 
three mouths* training (Groups V and VI); and with a C.R. of 20.12 
between them and those at the six months* training level (Group VII). 
The C.R. of the means of the two groups with three months* training 
(Groups V and VI) is statistically insignificant, ns on Form A, while the 
C.R/s of the means between these same groups at the three months* level 

Tabic 2 

Progress in Specialized Uadio Training at the General Educational Lovoi of High School 
Graduation, Showing Mj a- (dist.), for Each Level, and C.E/a bot\Yeen Lcvela 
of Specialized Training Separately for Forma A and B 


Form A 


Training Period 

Group 

Mean 

<r (disL.) 

N 

Three months 

V 

48,80 

0.66 

144 

Three months 

VI 

50.36 

10.32 

mm 

Six montliB 

VII 

62.06 

13.43 

11 

Critical Ratios 

Three months (624 hours) Group V 

VB. Three months (024 hours) Group VI 

1.30 

Three months (024 hours) Group V 

va, Six months (1,248 hours) Group VII 

10.67 

Three months (624 hours) Group VI 

VB. Six months (1,248 hours) Group VH 

9.39 

Form B 

Training Period 

Group 

Mean 

a (disb.) 

N 

No training 

IV 

27.30 

12.25 

126 

Three months 

V 

40.60 

9.92 

145 

Three months 

VI 

47.36 

10.33 

164 

Six months 

VII 

60.30 

12.77 

JOO 


Critical Ratiog 


No training Group IV 

V9. 

Tliree montiia (624 hours) Group V 

14.08 

No training Group IV 

va. 

Three months (024 hours) Group VI 

14,74 

No training Group IV 

V0. 

Six montha (1,248 houra) Group VII 

20.12 

Tluee months (024 houia) Group V 

vs. 

Three monthfl (624 hours) Group VI 

.64 

Throo months (624 hours) Group V 

va. 

Six months (1,248 hours) Group VII 

0.26 

Tliree montlis (624 hours) Group VI 

vs. 

Six mouths (1,248 hours) Group VII 

8.87 
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Table 3 

Progress in Specialized Radio Training at the General Educational Level of CollogG 
Studenta, Showing M, a (diet.), for Each Level, and C.R/b between Levels of 
Specialized Training Separately for Porms A and B 


Eorm A 


Training Period 

Group 

Mean 

tr (diet.) 

N 

Two months (416 hours) 

IX 

66.12 

6.03 

28 

Three monfcha (624 hours) 

VIII 

74.12 


25 

Three months (624 hours) 

IX 

76.00 

9.61 

30 

Three montha (624 hours) 

X 

76.09 

12.00 

34 

Critical Ratios 


Two months (416 hours) Group IX vs. Three months (624 hours) Group VIII 3.27 

Two months (416 hours) Group IX vs. Three months (024 hours) Group IX 4. 18 

Two mouths (416 hours) Group IX vs. Three months (024 hours) Group X 3,82 

Three months (024 hours) Group VIII vs. Three months (024 hours) Group IX .64 

Three months (024 hours) Group VIII vs. Three months (624 hours) Group X .71 

Three months (024 hours) Group IX vs. Three montlis (624 hours) Group X .22 


Form B 

1 

Training Period 

Group 

Mean 

ff (dist.) 

N 

Ono month (208 hours) 

IX 

31.34 

8.13 

28 

Threo months (024 hours) 

vin 

69.66 

8.73 

26 

Three months (624 hours) 

IX 

76.10 


3D 

Three months (024 hours) 

X 

73.64 

12.00 

34 

Critical Batios 


One month (208 hours) Group IX vs. Three montlia (024 hours) Group VIII 16.48 


Ono month (208 hours) Group IX vs. Tliree months (024 hours) Group IX 18.38 

One month (208 hours) Group IX vs. Three months (624 hours) Group X 16,63 

Three months (624 hours) Group VIII vs. Three months (624 hours) Group IX 2.05 

Three months (624 hours) Group VIII vs. Three months (624 hours) Group X 1.40 

Three months (624 hours) Group IX vs. Three months (624 hours) Group X .64 


of training and that pf the group with six monthfi' training (Group VII) 
are statistically significant, being respectively 0.26 and S.S7. Thus spe- 
cialized training levels are clearly differentiated by both forms at the 
general level of education represented by High School Graduates. 

College Students (Groups VIII, IX, and X): The radio trainees com- 
prising this level of general education received their specialized radio 
training at three universities in New York State, the course lasting for 
three months or 624 hours of instruction. The groups are distinguished 
from each other according to the university which they attended. Group 
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IX was tested at the end of one month's training with Form B, at the end 
of two months' training with Form A, and at the end of three months’ 
training with both Form A and B. Groups VIII and X were tested at 
the end of three months’ training with both forms. 

The means and sigmas of distribution of both forms at the different 
levels of specialized training, and tl\e C.R.'b indicating the statistical sig- 
nificance of the difference between levels of training are given in Table 3. 

The means indicate that the levels of specialized training nt one, two, 
and three months are differentiated from each other. The differences on 
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Fig. 1. LcsvcIb of radio training, sViOTving M, one <r, and range in acorea on Farm A 
for various amouata of radio training classified according to levels of general education. 


Form A at two and three months’ training are atatiatically' aignificaut* a 
C.R, of 3.27 existing between Group IX and Group VIII; one of 4.18 for 
Group IX; and one of 3.92 between Group IX and Group X. 

The data for Form E show that the differeucca between means at one 
month’s training (Group IX) and three months' training (Groups VIII, 
IX, and X) are highly significant, the C.R. being 16,48 between Group 
IX and Group VIII; 18.38 for Group IX; and 15.63 between Group IX 
and Group X, 
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The C.R/s of the means for the groups compared at the three months' 
level of training are statistically insignificant in all cases, This statistical 
insignificance of the differences between the means coupled above with 
the evidence of reliable differences between different levels of specialized 
radio training, indicates that the test is measuring progress in training. 
Progress in radio training is being measured within different levels of 
general education. Differences between levels of specialized training hold 
for both forms of the test. A graphic representation of these results ia 
given in Figures 1 and 2. 


Training 

paxlAd 
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G noa. 
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1 mo. 
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3 moB. 
(Group IX) 

3 moBt 
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Fig, 2, Levels of radio training, showing M, one cr, and range in scores on Torm D 
for varioufl nmounta of radio training classified according to levels of general education. 


Analysis of Reliability and Validity 

The measurement of progress having been indicated the next step was 
to check the equality of the forms and verify the reliability at the various 
levels of specialized radio training, and the different levels of general 
education; and to establish the validity of the teat. 

Equality of ike Porms. The two forms were compared at the different 
levels of specialized radio training within the levels of general education. 
Both forms were found to be equal in difficulty, with variability of per- 
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formance being much the same for both forms, ivith the exception of 
Group I at the general education level of High School Students, per- 
formance op Form A being slightly more variablo.' 

Reliability, The odd-even correlations, corrected by the Brown- 
Spearman formula for length, for all groups tested are given in Table 4. 
The parallel form correlations for those groups which were tested with 
both forms is given in the same table. 


Table 4 

Odd-Even and Parallel Form Correlation at AU Levels of General Education 


Odd-Even Corroktionfl 

Training Period 


Form A 



Form B 


Raw foB 

P.E. 

Tob* 

P.E. 

Raw To* 

P.E. 


P.E. 

Group I 

,63 

.00 

.69 

.07 

.63 

.09 

.69 

.07 

Group II 

,82 

,04 

,00 

,02 

,51 

.09 

.07 

,07 

Group III 

.80 

,04 

.88 

.03 

.88 

.03 

.03 

.02 

Group IV 





.80 

.02 

.59 

.01 

Group V 

,70 

.03 

,83 

.02 

.00 

,03 

.81 

.02 

Group VI 

.63 

,03 

.78 

.02 

.07 

.03 

.80 

.02 

Group VII 

.84 

.02 

.91 

,01 

.82 

.02 

.00 

.01 

Group IX (1 month) 





.74 

.04 

.86 

.03 

Group IX (2 months) 

.64 

,oa 

.70 

,05 





Groups VIII, IX, ondX 

.80 

.01 

.03 

.01 

.89 

.01 

.94 

.01 


* Corrected by BTOwn*Spearman formula. 


Parallel Form Correlationfl 


Training Period 

N 

r 

P.E. 

Group I 

28 

.39 

.11 

Group II 

34 

.73 

.06 

Group in 

25 

,44 

,11 

Group VIII 


,87 

,03 

Grbup IX 

30 


.05 

Group X 

34 


.02 

Group 0 VIII,IX,aiidX 

60 

.88 

.02 


High School Siudenta (Groups I, II, and III) ; The groups at the lowest 
level of high school training (Group I) have an odd-even r of .69 on both 
forma, This reliability is unsatisfactory at this lowest level of specialized 
training and level of general education, 

1 la an effort to save apace the tablea for this atmlyaiB have been omitted, but they 
may be obtained from the author. 




MeaBuring Progress in Radio Training 309 

The parallel form correlation of .39 for this group is likewise quite bw, 
and ifl not four timea its P,E. Thus any prediction of individual perform- 
ance on ono form fls compared to individual performance on the other 
would likely be no better than chance for members of this group, 

The group at the next level of tracing (Group II) has a reliability 
coefficient of .90 that is satisfactory on one form while on the other it is 
much lower (.67) and unsatisfactory. The parallel form correlation is, 
however, high enough to be acceptable. 

The group at the highest level of radio training among high school 
students (Group III) has reliability coefficients that are acceptable on 
both forms of the test. However, the parallel form correlation of .44 is 
quite low and just four times its P,E. 

High School Graduates (Groups IV, V, VI, and VII) : The reliability 
coefficients on both forms for all of the groups at the various levels of 
specialized training indicate that the reliability of the two forma is gen- 
erally satisfactory at this level of general education. 

College Students (Group VlII, IX, and X); The groups with three 
months* training were combined on one Pearson Product-moment chart 
for purposes of computing the odd-even correlation because it wag shown 
that their training was apparently identical as indicated by the means of 
all groups on both forme. 

The odd-even correlation (Form A) at the two months* level of spe- 
cialized training ig lower than for the other levels, with the reliability 
coefficient for three months’ training being most satisfactory. The 
parallel form correlations for the various groups at the three months* level 
of specialized training are quite satisfactory and indicate that prediction 
of individual, and group performance from one form to the other would 
be highly reliable. 

The reliability as shown by the odd-even correlation is acceptable at 
all levels of specialized radio training, with the exception of the first term 
students (Group I) at the high school level of general education. - The 
parallel form correlation at the general education level of High School 
Students is not as reliable as at the general education level of College 
Students where the coefficients are acceptable for group and individual 
prediction. 

Validity. The progress made in specialized radio training waa an- 
alyzed at three levels of general education, and within those levels groups 
were differentiated one from the other by the means according to progress 
in specixjJized radio training. Those differences between the means for 
the various levels of specialized radio training within each general educa- 
tional level was shown to be statistically significant, and was statistically 
insignificant between groups with specialized radio training. This dis- 
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tiugviiahing between levels of specialized radio training indicates a valid 
test of radio achievement. 

Another indication of validity is to be found in the low correlations 
which were found to exist between the radio achievement test and the Otis 
Intelligence test. Groups VIII and X were administered the Otis In- 
telligence Testj Higher Examination Form B, timed for thirty minutes 
and scored for the number right, and the results correlated with both forma 
of the radio achievement teat. Group VIII lias a correlation of -'.03 
between Form A of the radio achievement teat and tlie Otis Intelligence 
Test and .26 between Form B and the Otis Test; and for Group X a cor- 
relation of .05 was obtained between Form A and the Otis Teat and .02 
between Form B and the Otis Teat. Thus we have indicated by the low 
correlaticina, approaching zero in three instances, that there is being 
measured by the radio achievement test some capacity that is different 
from that defined capacity measured by this standardized and valid 
intelligence test. 

There being no known acceptable outside criteria with which this test 
may be correlated, the evidence of parallel form correlation ia offered 
in its stead. Each form of the radio achievement test at the general 
education level of College Students has a high self correlation, and each 
form correlates high with the other form. Both forms of the radio 
achievement test may be said to be valid radio achievement tests and they 
are measuring equally well that capacity which, for this study, is known 
as radio knowledge. 

Summary and Conclusions 

The purpose of this investigation was to measure training progress of 
radio learners, and to standardize the instrument thus used. 

Three levels of general education were represented in the subjects 
selected for measurement of radio training: High School Students, High 
School Graduates, and College Students. The subjects at the two highest 
levels of general education were selected from male applicants on the basis 
of a Civil SeiwicQ Aptitude test and a physical examination by Army 
doctors. 

A preliminary standardization of two forma of a radio achievement teat 
was made; the two forms compared for difficulty and variability of per- 
formance; odd-even correlation computed for reliability, and a bi-serial 
correlation of test items computed for the two forma. On the basis of this 
work the test was revised and the forms reevaluated. Both forms wore 
found to be close to equality of difficulty and variability of performance. 

The two forms of the test were administered to each member of three 
groups, with one, two, and three terms of radio training, at the general 
educational level ol High School Students. At the general educational 
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level of High School Graduates one form (Form B) was administered to a 
group of novices, and both forma were administered in alternate faahion 
to the members of the other groups. At the general educational level of 
College Students the two forma of the test were administered to all 
members of the three groups; while one group (Group IX) was tested with 
Form B at the end of one month, and Form A at the end of two months 
of radio training. 

Answers to the following questions were sought from the data thug 
accumulated: 

1. Are both forms of the test reliable at various levels of radio training 
within the several levels of general education? 

2. Is this a valid test of radio achievement? 

3, Are the two forms equal in difficulty and variability of performance 
for various levels of specalized radio training within each general 
educational level? 

4, What prediction of an individuals or a group^s progress in training 
exists for either form? 

The answers to these questions are the conclusions derived from this 
study. 

1. The test is a reliable test as is indicated by the odd^even and parallel 
form correlations shown in Table 4. The odd-even reliability coefficients 
range from -69 to -93 on Form A and from .67 to .94 for Form B at the 
various levels of specialized radio training with a median coefficient of .88 
for Form A and .85 for Form B. The lowest reliability coefficients were 
at two levels of specialized radio training within the general educational 
level of High School Students where the odd-even correlation was .69 for 
the lowest group (Group I) on Form A and ,67 for the middle group 
(Group II) on Form B. The parallel form correlation for Group I was 
.39, and .44 for Group HI. It appears from this that the test is less 
reliable at the lowest of the three levels of general education. 

2. The test appears to be a valid test of radio achievement at various 
levels of specialized radio training and general education. The magnitude 
of the parallel form correlations suggests this as shown in Table 4, The 
low correlations between both forms of the test and an intelligence test is 
evidence that the test is measuring some factor other than intelligence, 
which is assumed to be radio knowledge as that was what the students 
were studying, and that was what was tested. Essentially however, the 
test is valid because it differentiates between levels of specialized radio 
training within each of three levels of general education, and with dif- 
ferencea between the mean levels of specialized training that are practi- 
cally without exception statistically significant as shown in Tables 1,2, 
and 3. 
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3. The two forma are close to equality of difficulty at all the higher 
levels of specialized radio training for all general educational levels, with 
Form B slightly more difficult at the lowest levels of specialized training. 

4, The coefficients of correlation between levels of specialized radio 
training at the general educational level of College Students (Group IX) 
were of such magnitude (.62 to .82} aa to be acceptable for group predic- 
tions of training progress; and individual prediction as indicated by these 
same coefficients is increased from 20% to 40% above chance at the 
various levels of specialized radio training- 

In general, it appears that specialized radio training is alTected some- 
what by the level of general education (see Figures 1 and 2). 

Thus it may be concluded that training progress of radio trainees has 
been measured and a test has been standardized to accomplish it. 

Received Xujwf 7, 1944- 



A Study of the Effect of Music Distraction on 
Readmg Efficiency 

Mack T. Henderson, Anne Crews, and Joan Barlow 
OrinTull Ctlkpe, Iowa 

Very often college students claim that they con study effectively with 
the radio on, that music does not “bother" them. This suggested the 
following study which attempts to determine whether or not reading 
efficiency is influenced when music is used as distraction, and whether 
there is any difference in the influence of popular and classical music upon 
reading efficiency. In a similar study Paul Fendrick ‘ found that semi- 
closaical music tended to reduce efficiency, but since he did not equate his 
groups and because he used only one type of distraction, it was decided 
to supplement his results through this experiment. 

Procedure 

Fifty freshman women helped us with this experiment. These women 
were divided into three equally matched groups on the basis of their 
psychological examination scores (American Council on Education Psy- 
chological Examination, 1942 edition) and reading test scores (Nelson- 
Denny Reading Test) obtained in September, 1943. The A.C.E. means 
for the No Distraction, Classical, and Popular groups were 107.7 ± 22.6, 
102.6 ± 30.3, 103.6 ± 23.8. The means for the vocabulary section of the 
reading test were 43.1 ± 16.1, 42.6 ± 16.7, 43.8 ± 13.5, and for the 
paragraph section of the reading test 46.3 ± 11.6, 47,3 zt 11.7, 48.0 
db 13.9. The differences in these means were found to bq statistically 
insignificant as measured by Pisher i. 

First of all, the subjects filled out a questionnaire which was con- 
structed primarily for the purpose of determining whether or not the 
subjects were accustomed to studying with the radio on; whether or not 
they thought that the radio reduced their study efficiency; the amount of 
studying done with the radio on; and the type of program they usually 
listened to when studying. 

The Nelaon-Denny Reading Test was used in this study to measure 
the reading efficiency of the three groups. This test was chosen for four 
reasons: (1) it has two forms which made possible the use of one form as 

‘ Pendriok, P. The influence of music distraction upon reading efficiency. J. educ. 
net., 1637, 31, 264-271. 
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a pre-tesfc and the other as a final test; ,(2) Form A had been given to the 
freshmen Vi?hen they entered college, September, 1943, making pre-teat 
scores immediately available; (3) the test has two sections, a vocabulary 
section and a paragraph comprehension section, making it possible to 
determine the influence of distraction upon these subdivisions as well as 
upon the total scores; (4) the test required only 30 minutes to complete, 
10 minutes for vocabulary and 20 for paragraph comprehension. 

Form B of the Nelson-Denny Reading Test was administered, as the 
final test, to a group of 14 freshman women with popular music as distrac- 
tion and to a group of 17 with classical music aa distraction, while a third 
group of 19, a control group, took the reading examination without any 
distraction. Hereafter, these groups will be referred to as Popular, Clas- 
sical, and No Distraction groups. Popular and classical music were the 
two types of music chosen for this study, because the questionnaire results 
showed that they were the two types to which most of the subjects usually 
listened. Typical, familiar recordings of both types of music were care- 
fully selected to be played during the tests. The recordings used in this 
experiment are as follows: 

Musical Recordings: Popular music (order of presentation): 1. Two 
O^cIock Jump (Plarry James); 2. That^s What You Think (Krupa); 
3. Sunday, Monday, or Always (Frank Sinatra); 4. Mr. Five by Five 
(Harry James) ; 5. Prince Charming (Harry James) ; 6. Tuxedo Junction 
(Glenn Miller); 7. Idaho (Benny Goodman); 8. Crosstown (Glenn 
Miller); and 9, Close to You (Frank Sinatra), and Classical music: 
Symphony in D Minor by G&ar Franck (Philadelphia Symphony 
Orchestra, Victor Recording, 6726-6730). 

The conditions under which the tests were given were regulated as 
carefully as possible. The tests were administered on three successive 
afternoons at hours when the greatest number of the subjects would be 
free. However, it was impossible to find times when they were all free; 
hence, the rather small number of subjects. During the test, the subjects 
were asked to assume that they were in their own rooms studying with 
the radio on, The volume of the phonograph was predetermined by a 
group of judges, including students, and regulated to approximately the 
same loudness which the subjects ordinai’ily maintained when studying 
with the radio as background. These judges, who were stationed at 
various places in the room in which the tests were to be given, agreed 
upon the loudness desired. In order to assure some measure of similarity 
of volume, the position of the volume control was noted and used through- 
out the experiment. This method was resorted to, because a physical 
device for determining volume in decibels was not practical, since the 
volume within each record varied noticeably. 
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The significance of the differences in the means was determined by the 
Fisher t test. 

Results 

In Table 1 are recorded the averages of the No Distraction, Classical, 
and Popular groups, the differences between the averages of the pre-test 
scores and the final test scores of each group, and the significance of these 
differences in averages. It will be observed that the only score influenced 
by the distraction more than could be accounted for by chance is the 


Table 1 

Nelson-Dciiny Avcragea and i Scores 



N 

Pre-Tea fc 
(Form A) 

Final Teat 
(Form B) 

Difference 

i 

(Fialier) 

P 

No Distraction 
vocabulary 

19 

'13,1 

60.0 

+6.0 

1.260 

.20 

paragraph 


45.3 

49.2 

+3.9 

,923 

.35 

Classical 

vocabulary 

17 

42.a 

48,4 

+6.8 

.900 

.35 

paragraph 


47.3 

Ifl.l 

-1.2 

.260 

.80 

Popular 

vocabulary 

14 

43.8 

47.8 

+4.0 

.605 

.55 

paragraph 


48.0 

22.9 

-25.1 

6,160 

<.001 


paragraph score of the Popular group. This score was reduced 25T score 
points, on the average, below the pre-test score. It is interesting to note 
that the vocabulary scores of all three groups showed an increase even 
though the increases are not statistically significant as measured by 
Fisher t, 

In order to determine whether or not differences exist between those 
who are accustomed to studying with the radio and those who are 
unaccustomed to studying with the radio, the data of Tables 2 and 3 are 
presented. These data show that, regardless of the students^ study 
habits, the groups function alike. The paragraph scores of the Popular 
group showed a significant decrease in the final teat score whether students 
were accustomed to studying with the radio or not; all other test score 
changes were within the range expected by chance. 

In trying to account for the lack of influence or distraction of classical 
music upon the test results and the lack of influence of popular muaic upon 
the vocabulary scores, one can only suggest explanations. A. reasonable 
explanation for the lack of distraction of classical music is that the rhythms 
and melodies of classical muaic are usually more complex and less obvious 
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Table 2 

Nclson-Donny Averages and t Scores of Those Who Use the Radio When Studying 



N 

Pre-Test 
[Form A) 

Final Teat 
(Foim B) 

Biffctonco 

t 

(Fiahot) 

V 

No Difl traction 

14 






vocabulary 


42.3 

40.8 

+7.5 

1.089 

.30 

paragraph 


44,1 

48.0 

+4.8 

1.062 

.30 

Classical 

& 






vocabulary 


41,4 

50.4 

+0.0 

1.341 

.20 

paragraph 


47.8 

40.0 

-.9 

.134 

.86 

Popular 

& 






vocabulary 


45,5 

50.6 

+5.0 

.670 

.50 

paragraph 


53.8 

25.1 

-28.0 

5,485 

<.001 



Table 3 




Nelflon-Dcnny Averages and i Scores of Those Who Do Nob Use 




the Radio When Studying 





Pre-Teeb 

Final Teat 


t 



N 

(Form A) 

(Form B) 

Difference 

(Fishor) 

P 

No Distraction 

5 






vocabulary 


36.8 

40.6 

+3.8 

.631 

.60 

paragraph 


3^.6 

40.0 

+.4 

.042 

.95 

Claasical 

8 






vocabulary 


43.3 

40.1 

+2.8 

,245 

.80 

paragraph 


46.8 

46.3 

-L5 

,201 

>85 

Popular 

6 






vocabulary 


41.6 

44.2 

+2.7 

.244 

.80 

paragraph 


40.3 

20.0 

-10.7 

3,849 

<.001 


than those of popular music. The simpler and obvious rhythms and 
inelodiea of popular music are easily grasped by a group of subjects and 
are therefore listened to by the subjects. Naturally, while they listen to 
the music their attention is diverted from the task at hand. Classical 
music with its subtle rhythms and hidden melodies is apt to be vague and 
is therefore not “listened to.” It becomes a background against which 
the assigned task is accomplished without interference, and under these 
conditions it does not divert the subject's attention from hie work. Just 
what a group of persons highly trained in the understanding of classical 
music would do under the oonditiona of this experiment remains to be 
determined. 
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A likely explanation for the fact that popular music influences the 
paragraph scores and not the vocabulary scores seems to lie in the nature 
of the test materials. The paragraph materials are meaningfully related 
and require sustained effort on the part of the subject. In contrast to 
this, the vocabulary materials are intermittent and unrelated. This sug- 
gests that popular music interfered with the more complex of the two test 
sections. 

The suggested explanations might be summarized by saying that 
whether or not music is a real distraction depends upon the complexity of 
the music and upon the complexity of the test materials. In this experi- 
ment, the subtler music (classical) did not influence the test results, and 
the obvious music (popular) influenced only the paragraph section of 
the test. 


Conclusions 

1. Popular music distracted a group of subjects significantly on the 
paragraph section of the Nelson-Denny Reading Test. Classical music 
showed no evidence of distraction in either the vocabulary or paragraph 
sections of the test, nor did the popular music show evidence of distraction 
upon vocabulary. 

2. Students accustomed to studying with the radio were influenced as 
much or as little as students unaccustomed to studying with the radio, 

3. It is suggested that whether or not music serves as a distraction 
depends upon the complexity of the music and upon the complexity of 
the teat materials. 


Received June 19J^. 
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Tho length of ft review of a book or monograph wno indication of iU importance. 
Because of W.P.B. r^triotions on piipor reviewers of books have been requested to 
prepare their reviews in feweet pOBsible worda. Ed, 

Halaey, Georgo D. Making and using induslrial service ratings. New York: 

Hamper & Bros., 1944. Pp. xxii -)- 149. 82.60. 

^Thia book is intended primarily for operating and personnel executives 
who are interested in the practical aspects of Bervlce ratings— what has been 
done, what the difficulties lare, and how rating problems similar to theirs have 
been worked out successfully by other executives." The book^ however, 
eonta-iiiB material of value to anyone interested in employee ratinga. 

Ratings of nonaupervisory, supervisory and executive personnel are dis- 
cussed. NumBToua helpful excerpts and sample forms are presented, mostly 
from the field of public personnel administration, 

The author gives proper emphasis to such practical points aa hpw to train 
aupervifiOM to rate employees and to diacuaa the ratings with the individuals. 

"Service ratings have two distinct and different purposes: to servo as an 
aid in training and superviaion, and to furnish an evaluation of tho peraon's job 
performance as an aid in making sound administrative deciflione— ealary in- 
creases. layoffs, etc." In developing a rating plan it is important to distinguish 
carefully between these two purposes. The rating procedure will differ in many 
respects depending on whether it is designed to servo one or both of these 
pvirpo&ea. 

The efficiency rating system of the federal government is explained in con- 
siderable detail. It is evident that this plan is superior in every way to the 
graphic rating scale used almost universally in induaby. 

With regard to the problem of scoring a rating form, the approach ia both 
laborious and naive- From an attempt to attach numerical grades to employee 
ratings problems arise which cannot bo overcome in a practical situation. Logi- 
cal and statistical considerations, which the author completely overlookai pre- 
vent one from obtaining a total score "by adding the numerical values of the 
ratings on the separate qualities." There ia a wide-spread misconception on 
this point among industrial people. It ia not clear why it is necessary to grade 
the ratings in order to serve the training or administrative purposes outlined 
above. 

It is unfortunate that the book does not touch on the problem of using 
employee r/itings in a unionized organization. The broader problem is how 
can the merit of certain individuals be appraised and rewarded under oonditiona 
of collective bargaining. 

This book ia a worthwhile contribution to fcho literature on rating industrial 
employees. Although the approach is not scholarly, most of the content ia 
sound and, above all, it ia Toaliatic. 

Charles C, Gibbons 

Owens'lUinois Glass Co., 

Toledo^ Ohio 
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Caaon^ Eloiae Booker. Mechanical methods for increasing the speed of reading. 

An Experimental Study at the Third Grade LeueL New York: Columbia 

TJnivereity Contributiona to Education, No, 878, 1943, Pp. 80, $1.75. 

This monograph ia a complete report of an experiment eet up to answer a 
Bpecific question for a apecific group of Bubjects: Does intensive training in cor- 
rect eye movoinenta improve measurable reading akills to a greater extent than 
would the use of the eame amount of time for free library reading? Tho experi- 
ment is admirably designed to produce an unequivocal answer. Paired groups 
of third grade children (25 pairs in School A, 26 pairs in School B) were used n 5 
Bubjects. Pairing of individuals waa based on scores from the Gates Beading 
Survey Test, but Tables 1 and 2 indicate that the groups were closely similar 
on the Otis Intelligence Test as well. Twenty-minute training periods were 
scheduled five times a week for four weeks under the direction of the regular 
teachers, no other reading instruction being given during the experiment. In 
School A, experimental subjects read printed material marked and spaced to 
call attention to phrases. Control subjects read library materials in the same 
room. In School B, experimental subjects practiced with the Metron-O-Scope. 
Control subjects read library materials in another room. Before and after the 
four-week training period, the Gates Beading Survey Tests end several now 
tests specially constructed to measure skill in the reading of phrases were given. 
Results bearing on the main problom were definite and clear-cut. In neither 
school was ihere a siatiotically significant difference on any test between ike means 
of the experimenial and control groups. 

The data were then analyzed in aevernl other ways. In order to throw light 
on the question as to whether the effects of method may differ for children of 
different ability levels, each group was divided into upper, middle, and lower 
thirds. Since this would place only about eight or nine persons in each sub- 
group one would anticipate difficulty in demonstrating that any differences in 
gains were statistically aignificaut. ‘Therefore, it is interesting to find, using 
the t-tost, that a few were. In the School A Phrase Material Group, the upper 
third lost in apepd while the middle third gained. In the Metron-O-Scope 
Group the upper third gained significantly more in comprehension than the 
lower third. In the School B Library Group, the middle third gained signifi- 
cantly more in comprehension than the lower third, Though results baaed on 
60 few cases cannot be conclusive, they suggest the desirability of special 
investigation of this problem. Another sort of analysia used the results of a 
re-administration of the Gates Test after summer vacation. There were still 
no reliable differences between equated groups. It Rsemed to this reviewer 
that the most interesting difference in the whole study was one which the author 
declined to interpret because of uncontrolled factors in the two situations, 
namely the difference between schools in gains on the Gates Test. In School A 
there were no significant gains for either group. In School B, both experimental 
and control groups showed gains of one-half to three-fourths of a year of reading 
age, gains which persisted over the summer vacation period. When one re- 
members that the practice periods added up to less than seven hours altogether, 
these figures seem very large. Whatever the uncontrolled factors were which 
accounted for this result in School B may well be of more practical importance 
than the factors fclio experimont was set up to test. 

There are a few places where the statistical explanations are a little obscure, 
but there seem to bo no errors in procedure which would cast doubt on the 
dependability of the results. The findings of the study as a whole will lend 
support to the arguincnta of those who hold that meehanical and motor skills 
are less important aspects of reading than are intelleptual and motivational 
factors. Since free reading is much simpler and less expensive than the me- 
chanical methods, the results should have definite practical application. 

Leona E. Tyler 


University of Oregon 
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Sargent, S. Stanafeld. The basic tcflc/iinos 0/ the great psychologisl^. NG^Y York; 

Ne ^7 Home Library, 104d. Pp, xiv + 346. $.00. 

The hook covers about all the major topies in psychology with a pretty (air 
balance. It includes most of the applied field aa well na the general field, but 
the former is usually somewhat implicit in tlio discusBions of tlio latter rather 
than being set off by itself as applied psychology- In each chapter the treat- 
ment is essentially chronological, comprising a brief summary of the findings or 
theories of quite a number of people on the topic under consideration. The 
treatment is not critical, and the controversial questions are loft open, 

The author indicates that it is written for the layman and secondarily per- 
haps aa a refresher for advanced sfcudcnta. The reviewer believes that these 
two markets should be reversed in importance, Tho layman will find the dis- 
cussion somewhat cluttered by the names of so many people unfamiliar to him, 
and he will not find an extensive topic in which ho might be interested treated 
at any Icngtht It is, of course, imposaible to cover so much ground in any very 
systematic fashion. Occasionally, too, some technical term is introduced with- 
out any explanation, although later in the book it may be discussed in more 
detail. On the other hand, the advanced student might find it quite helpful as 
a sort of thumbnail review of the whole field, and he would be almost certain 
to encounter some bita of information here and there that would be a helpful 
flupplement to hia existing knowledge on a topic, The author must have cov- 
ered a tremendous amount of source material in order to formulate the coneisD 
paragraphs which he does oa so many topics by 00 many people, From that 
fitanapomt the job is well done. 

Tho title of the book is subject to criticism, There certainly are not aa 
many '^great^' psychologists as listed. The biographical notes at the end 
include some two hundred pflyohologiata. It is probably not the author^a fault, 
but the publisher's blurb on tho jacket is in poor taste and smacks of ^^gold 
brick,” 

Harold E, Burfct 


Ohio Stale Univemly 
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Andnow to live again, Betsy Barton. New York: D. Appleton-Century, 

1944. Pp. 150. $1,76. 

Psychology of personnel. Henry Beaumont. New York 3: Longmans, 
Green & Co., Inc., 1945. Pp. 300. $2.75. 

Employment opportunities in chaTacterislic industrial occupations of women, 
Elizabeth Benham. Bulletin No. 201, Women’s Bureau, U, S. Dept, 
of Labor, 1944. Washington 25, D. C.: U, S. Government Printing 
Office. Pp, 50. $.10. 

Yowr place at the peace table. Edward L. Bernaya. Duell, Sloan & 
Pearce, Inc., Dept. 3F-12, 270 Madison Avenue, New York 16, N. Y. 
Pp. 60, $1.00, 

Psychology: Principles and ap'^icaiions. T. L. Engle. Yonkers-on- 
Hudson 5; World Book Co., 1946. Pp. 549. $2.12. 

The classification of Jewish immigrants and its implications. A survey of 
opinion. N, Goldberg, J. Lestchinsky, and M. Weinreich. Yiddish 
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The Measurement of Supervisory Quality in Industry * 

Quentin W, File 

Purdue Unmmly 

In any organization engaged in a productive activity there must be 
individuals wlro assume rcsponsiliility Tor directing productive procedures 
at the operational level. The Army has its sergeants; the school, its 
classroom teaclicrs; and the church, its ministers and priests. Industry, 
likewise, must rely on its all-important directors of operations, its 
supervisors. Upon these supervisors rests the responsibility of seeing 
that all the creative planning, technical research, and personnel policies 
bear tangible fruit in the form of maintained or improved productivity. 
Operating supervision is the connecting link between top management 
and the worker, and tlie chain of harmonious industrial relations can 
be no stronger than thi.s‘ key link. 

In order to establish a common basis of understanding, let us define 
an industrial supervisor as an individual who actually directs the pro- 
ductive processes at the scene of opciution. Such a definition would 
include individuals between the group leader and departmental supervisor 
levels. 

To moot the wartime demand, supervisory training programs have 
been instituted both Ijy industry and by the government. Most of the 
training has been carried out on an "on-the-job” basis so as to provide a 
minimum of interference with regular work activities. In spite of the 
extensive p\ihlication.s describing the various types of training programs 
and testifying to the merits of each, little has been said about the need 
for objectively evaluating the outcomes of such programs or about setting 
up a systematic inctiuHl for evaluating supervisory quality. 

* Tills article is biased on the niitlior's Diesis oi tlie same title, submitted to the 
kttculty of Purdue University in partial fulfillment of the requirementa for Uic degree of 
Doctor of PiiiIo.Hophy, Juno, 19-M. Tliis study was carried out under the direction of 
Trofessor H. H, Ilciiiinors in collaboration with ten industrial concerns. Funds tor 
this research were provided by the Division of Education and Applied Psychology of 
Purdue University. 
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The need for some iDstuument for measuring auperviaory quality 
becomes apparent when one considers the uses to which aucli a test could 
be put, A good supervisory ability test could be used; (1) to select and 
classify candidates for auperviaory training; (2) to evaluate the outcomes 
of supervisory training; (3) for upgrading; (4) to check on the quality of 
present supervisory personnel; (5) as a basis for interviewing and counsel- 
ing auperviaors; and (6) as material for group diflcuaaion at supervisory 
meetinga. 

Management was long prone to assume that to obtain the best super- 
vieor one should promote his best worker. In other words, it assumed 
auccesa on a given job to be a reliable measure of the ability of the 
individual to supervise others who do tlie same kind of work. That 
such is not the case has been repeatedly proved. Ability to deal with 
personalities, loyalty to management, interest in work and numerous 
other factors make it necessary to consider knowledge of a job and other 
specific factors merely an essentiol part rather than all of tho require- 
ments for good supervision. 

The general factors of eiipervision arc many. Each superviaor, 
regardless of rank and experience, must deal with the attitudes of Ida 
workers, his associates, and his bosses. He must administer company 
policies. He must decide what explanations of wage differentials, vaca- 
tion preferences, penalties, and the like must be given, And, most of all, 
he must be sensitive to potential disunity and dissatisfaction among his 
workers in order that the difficulty can be corrected before it reaches a 
point where production will be affected. 

Construction of the Teat 

In the construction of an instrument for measuring supervisory 
quality, consideration must be given to the relative importance of both 
the general and the apoci&c factors involved. The seemingly predomi- 
nant importance of the general factors of supervision is emphasized by 
the large number of hooka and articles now expressing the need for im- 
proved understanding of human relations and the importance of per- 
sonalities in achieving industrial harmony. The following statement by 
Dodd and Rice ^ ia illustrative of present personnel trends: When it 
becomes necessary, new supervisors are selected from the ranks of 
workers, engineers, technicians, and other sources. Experience proves 
conclusively that intelligence, personality, vitality, and leadership should 
outweigh technical or trade ability when tho selections are made.” 

Most industrial supervisors are obtained by some form of upgrading. 
It seems quite possible, therefore, that any individual, who ia able to 

^Dodd, A, E., and Riae, H. 0., cda., Uow io train workers for war induslries^ p. 80, 
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qualify for supervisory position on the basis of his general abilities, will 
either have acquired, or can acquire, the specific knowledge necessary for 
handling the job. It was on the basis of the hypothesis that factors 
generally cofnmon to induslrial supervisory positions are the really important 
quantities that this project of constructing a valid measure of supervisory 
quality was conceived. 

When developing any teat, it is necessary to make certain basic 
assumptions. The principal assumptions of this study were: 

1. That ability to supervise workers is something general in nature 
rather than highly specific to a given job or company. The supervisor's 
effectiveness is, in the long run, dependent upon his understanding of 
and ability to deal with human relations. 

2. That lack of this general ability to deal with workers is the greatest 
single cause of supervisory failures and of management-worker friction, 

3. That knowledge of how to handle the supervisory function can be 
tested by obtaining responses to certain significant questions which are 
drawn directly from problems which frequently confront the supervisor, 

4. That such questions can be obtained by direct contact with 
super visors on the job, by careful study of the literature concerning 
supervisory fundamentals and supervisory problems, by taking into 
account the relevant principles of psychology, and by systematically 
'hveeding out” those items which prove unfruitful. 

In selecting the items for the supervisory ability test, Hom Supervise? 
three definite objectives were kept in mind. 

1. The items must be presented in problem form calling for an 
operational response, i.e., the items should ask “What should be done 
. . . ?” or “Is it desirable to . . . ?”, etc, 

2. The items must have “face” as well as statistical validity. They 
must present problems which are pertinent to industrial supervisors 
regardless of the department or the company from which the supervisors 
are selected. 

3. These items must bo simply worded so that any supervisor can sec 
the problem involved. 


Item Selection 

Items for Flow Supervise? were selected from three distinct sources: 
publications concerning industrial supervision, suggestions from in- 
dustrial supervisors and personnel men, and contacts with labor leaders. 
The most fruitful and readily available source of potential items was the 
industrial literature. Industrial supervisory probloma have received 

2 Sample copies of this tesb may be obtained from the Psychological CorporahoD, 
622 Pif th Avc., New York City. 
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considerable attention in the Iasi half decade and much hag been written 
about the importance of harmonious supervisor-worker relntiong. Es- 
pecially valuable of the published works were the human relations 
manuals and books dealing with specific supervisory problems and their 
solutions.* Contacts with various supervisors in a sizable manufacturing 
concern offered a means of checking on the practicality of the problems 
presented and of obtaining additional items. 

From the eources mentioned above a pool of 204 items was gathered 
for the experimental edition of H ow Siuperuise^ . Those items ^Yere divided 
into two numerically equal forms. Where items dealt with closely 
related problems, those items were placed in different forms. All other 
items were divided on an odd-even basis. Many of the items deal with 
problems now under heated discussion. These items were purpoaely 
included in order to give the test added value as a basis for supervisory 
conferences. 

The personal data which the supervisor was asked to provide were 
purposely made extensive in order to investigate possible rclationaliipa 
of these data with test scores and with maimgemont^a ratings. This 
section was purposely placed at the end of the test for three reasons, 

1. The supervisor will be more likely to give hia undivided attention 
to oral instructions at the beginning of the test if not presented with 
preliminary material to be filled out before answering the teat items. 

2. Any resentment which might occur from a fairly extensive act of 
questions will not affect his responses to the items of the test. 

3. Since tests arc usually scored from front to back, the total score 
and the name of the supervisor are brought together with a minimum 
of page turning. This advantage was also evident when responses to the 
items were punched on tabulating machine cards. 

Item Validity 

The validity of a test item must always be described as validity with 
respect to some standard of value. One of the most vital, and usually 
the most difficult, problems of test construction is that of securing an 
adequate criterion. One criterion for a test of supervisory quality is 
obviously "success on the job.^' Success, however, must be defined in 
terms of some standard and by some individual or group of individuals. 

The problem also arises as to what arc tlie beat answers to the items 
of a test. To meet the above problem two assumptions were Vnade: 

1. "Good*’ supervisors as a group know the best answers. 

^Gardiner, Glenn Ir., Better Foremanship, Firafc Edition. New York: McGraw Hill 
Book Co., Inc., 1936. Heyel, CarWHuman Relations Manual for ExeculiveSf New York: 
McGraw Hill Book Co., Inc,. 19,10. 
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2. Men who wrile books and articles on industrial supervision and 
men actually engaged in directing auperviaoiy training programs as a 
group know the correct answers. 

Unfortunately, simply to assume that fcJie best supervisors know the 
correct answers, though logically aoiind, does not provide an adequate 
criterion. The really crucial problem becomes one of determining who 
these good supervisors are. The writer felt that two groups of people 
should know — (1) the men who work under the supervisor and (2) the 
individuals to whom the supervisor is responsible: in other words, his 
bosses. 

Ratings by members of management above the supervisor proved 
more available than those of the workers. Out of a total of 972 super- 
visors tested 5.77 sets of four ratings were obtained. The instrument 
used for rating was The Purdue Rating Scale for Supervisors constructed 
by H, H, Remmers and the writer for use on this study. This scale 
asked for an evaluation of the auperviaor in terms of seven factors and an 
overall evaluation of his quality when all factors were considered. 

The orthodox method of test validation consists of having ao-oalled 
'^experts'^ answer the items of the test and using their responses as a key 
for obtaining a total score for all individuals tested. This total score is 
then used as a criterion for determining the degree of discrimination 
possessed by each item. 

Foremost of the problems in obtaining expert judgments is the 
problem of determining who the experts are. Two groups of individuals 
were sampled to get the expert judgments needed to provide a scoring 
key. Group One of the sample of experts consisted of eight individuals 
who had either written articles or books about industrial problems, or 
were recognized authorities in the field of mental hygiene. To insure 
careful consideration of the test, a check for $10 was enclosed with each 
set of materials sent out. 

Group Two of the experts consisted of thirty-seven individuals work- 
ing for the government under the Division of Vocational Training for 
War Production Workers. Twenty-four different states were repre- 
sented with no more than five individuals from any state. No financial 
reimbursement was given any member of this group and all responses 
were on a purely voluntary basis. Both groups of experts were asked to 
criticise each Item and offer suggestions for improvement as well as to 
give the answers they considered best. 

All scoring of the supervisors' responses was done from tabulator 
cards. A scoring key was obtained by finding the responses most 
frequently judged best by the two groups of experts combined. Com- 
bining the responses of the paid experts with those of the Training 
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Within Industry group wag justiliGd on the basis of a correlation of 
+ ,91 zt .01 between the modal responses of each group. Items about 
■which the experts were unable to agree and tliose on which the modal 
responses were ^^uncertain” were not used in obtaining the total tost score 
for the supervisors. 

The average supervisor tested for this stucly \Yas fcl\u*ty-foi\r years 
old, married, with one or two dependents, and probably dididt own hia 
home. Ho had a high school education and had ialcen a auperviaory 
training course. He had worked nearly ten years before becoming a 
supervisor and over six years since becoming one. He was in charge of 
forty-nine workers of both sexes* In the last ton ycar.s he had been 
employed by two different companies. 

Tiutlier analysis revealed that: only 2% of his fellow supervisors wore 
women; 15% of all aupervisorfl had worked less than two years before 
being promoted and that 38% had been supervisors less than two years; 
only 5% were single while almost 20% had no dependents; i5% owned 
or were buying their homes; 23% had some college training and two- 
thirds of the group had completed supervisory training courses; about 
30% had been ■with their present employer for at least ten years or else 
had never worked anywhere else; and 73% supervised both men and 
women while only 2% supervised women alone. 

These supervisors were drawn from ten industrial concerns, The 
number of supeivisors contributed by each concern was a function of the 
size and organimtion oi that company. 

Tests of the discriminating power of each item of the experimental 
edition of How Supervise? were made with respect to both of ilie criteria 
pre'viously described, namely, managements' ratings and total scores on 
the test. The method used to determine each item's discriminating 
power was the critical ratio of the difference between the average re- 
sponses of the upper 27% and the lower 27% of the siipeivisors with 
respect to the criterion. This method was favored because it involved 
no assumptions as to the right and wrong answers to individual items. 
To the extent that a given item yields significant diffcrencc.s with respect 
to an acceptable criterion, tlic item can bo considered valid and its 
correct answer will he indicated by tlie direction of the difference between 
the upper and lower groups. Thus, as was the case with tliis study, 
when a fallible criterion is used, tlio validity coefficient obtained for a 
given item depends only on the item's value and the general validity of 
all of the experts' judgmentg. Weakness of the experts' responses to 
any one item docs not make it impoaaiblo for the item to show a significant 
discrimination ratio. 
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When selecting items to be retained for the final forms of How Super- 
vise? four different factors were considered: 

1. Size of the critical ratios of the differences between the upper and 
lower groups with respect to total score on the test. 

2, Size of the critical ratios with respect to management’e ratings. 

3, Degree of discrimination throughout the continuum of possible 
answers, i.e., difficulty of the item. 

4. Company to company variation on the item. 

Most important of the above factors used to determine the value of 
the items were the critical ratios of the differences with respect to total 
score on How Supervised This criterion was favored because of the high 
agreement between different groups of experts and significant differences 
between the upper and lower groups of supervisors, 

Study of the Criterion 

In this study considerable time and statistical attention was given 
to management's ratings. It was hoped that a criterion could be ob- 
tained whicli would be independent of the items of the teat itself. The 
desirability of securing this independent measure of supervisory quality 
is readily apparent when one reviews the advantages which such a 
criterion offers, 

1. Management ratings are made at the octual scene of operation. 
In addition to being independent of the experimental edition of the test, 
such ratings should constitute a measure of actual success on the job. 

2. Since management is solely responsible for determining what 
individuals will be promoted to supervisory positions, much can be said 
for selecting those individuals who measure up to management's 
standards. 

3. Management as a group should be more adept at making ratings 
since most modern industrial organizations make use of some form of 
merit rating. 

The 577 supervisors rated for this study were employees of six different 
industrial concerns, ranging in size from 600 workers to 20,000 woricers. 
Reliability coefficients and intercorrelationa of the rating scale items were 
compel ted for the entire population tested. In general, the correlation 
between the traits of the rating scale tended to be greater than the reli- 
abilities of the traits correlated. At least 17 of the 28 item intercorrela- 
tions significantly exceeded 1.00 when corrected for the unreliability of 
the items. Since no correlation above 1,00 can exist in practice, it must 
be assumed that corrections for attenuation are not applicable to these 

data. The formula, = “F===j corrects for chance unreliability of 

y rxxTTvY 
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fchc items, but, like all other formulae assuming raiidoni sampling, mnlcea 
no allowance for constant or systematic errors. This formula zs, there- 
fore, not appUcMble to data in lukich these constant errors occur ^ 

Many nutliois of statistical texts have assumed that there can be no 
significant correlation between completely unreliable measures of a given 
pair of traits.^ When corrected correlations [il.)ov(3 1.00 wore found, 
these correlations were assumed to he due to sampling error. It was 
assumed that further sampling would rovcMil cither lower item inter- 
correlations, higher item reliabilities, or both. 

The writer advances the hypothesis that under conditions where 
eKccssive halo ® and logical errors exist, these spuriously high infccr- 
covrelations beUeen traits can bo obtained from Ruccessivc samples ot 
randomly selected ratings. The only requirement for such a condition 
is that the logical relation of one trait to another be greater for all raters 
than the reliability of those raters' judgments. 

Four tests of refined methods of scoring the Management Ratings 
were made. In the data tested all attempts at statistical refinement 
failed to reveal significant iiicrenscs in the reliability of the ratings. The 
methods tested include weighting by Beta weights, z-scorcs, and item 
relialnlities. 

Of the 204 items of l)oth forms of the experimental edition of IIow 
Supernise? 23 itcjns yielded critical ratios of 2.00 or l;eltc]- for tlio cliiTor- 
ences between the upper and lower groups ns selected by nmnagoment 
raiinga. Since less than five items could be expected to occur by chance 
under these conditions, some idea of whnt management expects of its 
supervisors can possibly be gained by examining the nature of these items. 

Assuming that the item preferences of maiiagement-aelocted super- 
visors do reflect management's opinions of what constitutes good super- 
vision, the following observations can be made. Management believes: 

1, Its supervisors should accept responsibility for keeping their 
department's production up and its co.sLs down, 

2, In standardized proceclurc.s even to the point of failing to recognize 
the importance of individual differences among workers. 

3, In deeds rather than words. 

4, Its supervisors' first and foremost responsibility is to management. 

5, Flues arc not the best way to discipliuo wovkors. 

6, Workers should not be given regular rest periods. 

7, Procedures for granting raises and promotions arc management's 
business, not the workers', 

^Pcfccra, Charles C., and YanVoorhis, Walter H., Statistical 2irocedure3 and their 
imiheinatical basis. 

^ Tiffin, Joseph, Industrial psychology. 
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Probably most significant of the findings on the management-rating 
criterion is the absence of any significant critical ratios on items dealing 
with the mental hygiene aspects of supervisor-worker relations. Most 
of these items were highly significant on the total score criterion. One 
may well wonder to what extent the principles of improved personnel 
relations have trickled through to operational levels. 

To investigate the relation of management's ratings to personal 
information about the supervisors, the correlations between ratings and 
age, marital and home status, education, working experience, special 
training, number of men supervised, and number of companies worked 
for were computed. Only three of these correlations were significantly 
above zero at or above the 5% level of confidence. There appears to be 
a slight tendency for supervisors, with a great deal of working experience 
before being promoted, to receive somewhat higher ratings. Supervisors 
who have taken supervisory training courses are rated slightly higher, 
More significant, however, is the relation between number of men super- 
vised (an indication of rank) and management's ratings. This relation 
is a natural one since it is generally assumed that promotions are most 
frequently given to individuals whom management considered best. 

Validity of Management's Eatings 

Since the analysis of results on The Purdue Rating Scale far Super- 
visors revealed management's ratings to be of questionable validity, 
wore used as a secondary criterion for the y^Jidaiion of the test 
items rather than as a principal basis for the selection of discriminating 
items. Reasons for skepticism as to the validity of this criterion are 
listed below. 

1. Unusually large halo effect indicating that only one general factor 
was being measured. 

2. Relatively low reliability of total scores on the ratings. Near- 
significant increases in reliability were obtained where corrections for 
differences in judges were possible. Since this correction could not be 
made on 80% of the ratings, a known source of sizable errors did affect 
the validity of the criterion. 

3. Variations in quality of raters from department to department 
doubtless existed. Such variations would tend to increase the spread 
of the rating scores and thus increase the computed reliabilities. 

4. Almost complete failure to find significant discrimination values 
on supervisory problems recognized by industrial experts as important; 
items which two groups of experts were able to agree upon. 

Several hypotheses can be advanced for the failure of management's 
ratings to prove their worth as a criterion. The following seemed most 
tenable to this writer: 
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1. The pyramid of authoTity inh6rent in industrial organ! zationa 
does not provide the necessary contacts for multiple rating by manage- 
ment, Sound organization, according to this hierarchy, requires that 
each supervisor is responsible to only one individiiah Hequiring four 
men to rate a Bupervisor probably necessitates calling in raters who have 
had little contact witli the person they rate. 

2. Rating conditions are more difTicuU to fitaiulardize than testing 
conditions, Inherent in these ratings are Buch factors as personal 
relations between rater and supervisor, personality charaGteriatica of the 
rater, hia experience in rating, and company attitude toward merit rating. 

3. Varying standards adopted by ratera in a highly skilled department 
as compared to raters in a non-technical division and company-to- 
company variations can account for extremely wide variations in rating 
scores which have no basis in terms of supervisory quality. 

4. Quite possibly either or both management rating and How Super- 
vise? deal with only part of the required abilities necessary for good 
supervision, Tor example, operational management has long disre- 
garded the area of mental hygiene for workers and the cPEcets of employee 
attitudes. Hov) Supervise? deals primarily with this area. 

Judgment of Experts 

In addition to being asked to provide the best answers to the experi- 
mental edition of How Supervise?^ each of the industrial experts was 
asked to mark items which he thought were ambiguous ov of no value and 
to indicate any corrections or comments he cared to make, Each expert 
was also asked if he thought the language used in the items would be 
understood by supervisors and if the approach to the problem was a 
practical one. Over 90% of the experts thought the language was 
sufficiently clear, while between 75% and 80% thought the approach 
to the problem practical. 

Two indications of the reliability of the experts' responses were 
obtained: (1) a correlation of .01 betw'een the modal responses of the 
paid experts and those of the Training Within Industry experts, (2) a 
correlation of .80 was obtained between the experts' scores on Form A 
and their scores on Form B when scored back on the key derived from 
their modal responses. This would indicate that the reliability of the 
total score criterion was approximately .89. 

Traditional requiiemonts for test validity were well satisfied in this 
experimental study of How Supervise?, Experts in the field in which the 
field in which the teat ia designed to operate were able to agree as to the 
correct answers to the items. The reliability of the experimental edition 
was found to be .84 i .01 for scores on the two forma of the test combined 
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{N - 577). Wide variations in the total scores made by supervisors 
were found ranging from near chance to almost complete agreement with 
the scoring key. 

As would he expected, wide company differences in the average 
quality of supervisors, as moasurod by total test scores, wem found. 
Of the forty-five difTcrcnces between the average test scores made by 
fiuporvisors of the ten companies tested, 15 wore significant at the 10% 
level, IG at the 6% level, and 7 at the 1% level of confidence- This 
would indicate that soinc factor or factors were measured by the teat 
which exist in varying amounts in different companies. This ia es- 
pecially interesting since significant differences were also found between 
the scores of given groups of superviaors at the beginning and end of 
training periods, The significant improvement measured in the latter 
situations indicated that tlie test was measuring an. improvement which 
occurred during this period and that there was an overlapping between 
material covered in the course and the content of How Suyervisef, 

Validity of How Supervise? 

Briefly summarized, the experimental indications of the validity of 
How Suyeruhe.? are: 

1. Supervisory achievement in industrial training courses has been 
mcflaured and significant improvements found. 

2. Areas which industrial experts consider vital have been reliably 
measured with test items about which the expezts agree. Coefficient of 
Reliability = + .84 ± .01. 

A study was made of the relation between total score on How Buyer- 
vue? and such personal information as marital status, age, education, 
number of men supervised, etc. Several corrclatioiiB were found which 
were significantly above zero but not of sufficient size to indicate that 
pergonal data would be of importance in selecting good superviaors. A 
correlation of + .35 between education and total test scores is the only 
relation of sufficient size to be of importance in the selcctioTi of supervisorg. 
The optimum amount of correlation which should exist between education 
and a test of supervisory quality is problematical. While such a test 
should not correlate highly with amount of education, doubtless, foimal 
education does provide valuable learning situations which are generally 
helpful. 

It is interesting to note that the greater proportion of this correlation 
resulted from differences between supervisors who had college training 
and those who did not have college training. For example, 44% 
of the elementary school graduates were above the 60th percentile on the 
overall norms, and 60% of the high school graduates were above this 
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poict. At the Gollege level, however, 69% of the auperviaora who com- 
pleted one year of college and 74% of the college graduates were above 
this median score for all supervisora. This would seem to indicate that 
selection at the college level tends to ''weed out^' individuals who have 
failed to develop an understanding of the general factors of human 
relations, or that colleges in the student's first year of training provide 
considerable opportunity for gaining insight into human relations 
problems. 

No major changes were made which seemed likely to cause the 
BuperviBor to place a different interpretation on the problem presented. 
Revisions were made only on items whose relation to the total score 
criterion was significant and which comments by either the experts or the 
supervisors tested indicated some confuBion in interpretation. 

Items not included in the final form were disqualified for the following 
reasons: lack of discriminating power, too easy, or weak on one or more 
criteria. 

Each form of the final edition of Hm Suj}emse? containa 70 itema 
which are divided into three categories. Care has been taken to make 
each division of a given form equivalent to its oonesponding division 
in the other forniv Each diviaion ia equated on tho following factors: 

1. Variability of the item — standard deviation of all supervisors' 
responses. 

2. Discrimmation index— critical ratio of the difference between the 
mean responses of the upper and lower groups. 

3. Difficulty index — deviation of the average response of all super- 
visors from the correct reaponae. These values were computed on the 
basis of a three-answer continuum. 

4. Number of positive and negative items in each category of each 
form. 

Quite naturally, industrial participation in this experimental program 
was not of a benevolent nature. To insure that the companies, as well 
as we, would receive appreciable benefits, the following reports were sent 
to each, cooperating concern. 

1. Scores for each supervisor on the test with percentile values based 
upon norma for all supervisors tested in this study 

2. Individual reporba on tho quality of each supervisor as rated by 
four members of management. 

3. Summaries of supervisors’ scores on the experimental edition of 
Hoiij Supervise? by departments where a sufficient number of superviaors 
were tested to make such breakdowns meaningful. 

4- An overall summary of the company's scoree on the test with an 
indication of their relative position with respect to other companies 
tested. 
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5. An item-by4tem tQ,bulatioii of the per cent of the comp any 
Buperviaors who gave each of the poasible reaponsea to that test item. 

6. Where forma of the test were given at the beginning and again afc 
the end of a training period, comparisons between each supervisor 'a 
scores were given, together with an overall evaluation of the program 
as a whole. 


Summary and Conclusions 

Conclusions drawn from this study can best be made in terms of the 
hypotheses advanced when plans for the experimental project were 
conceived. These hypotheses logically fall into three categories: (1) 
those which deal with the nature of industrial supervision, (2) those which 
are concerned with criteria against which supervisory quality can be 
measured, and (3) those which deal with methods of scoring and com- 
puting data. Both the hypotheses and findings concerning them are 
discussed below. 

The hypotheses advanced as to the nature of industrial supervision 
were: 

1. Important aspects of industrial supervisory ability can ha measured 
by test items which are equally applicable to all industrial concerns. True. 
140 discriminating items were found in this study; items which showed 
no significant variation with respect to the size or nature of the industrial 
concern. Confidence in the importance of these items was expressed by 
both industrial experts and management. 

2. The menial-hygiene aspects of industrial supervision are of primary 
importance. In other words, supervisor-worker relations are among the 
key determinants of good or poor supemsion. True. Several indications 
of the validity of this hypothesis were found, 

а. The average discriminating power of the items of How Supervise? 
which dealt with human relations was significantly greater than the 
average discriminating power of factual items. 

б. In response to a felt need, the last decade has witnessed innumer- 
able publications of books and articles dealing with the human-relations 
aspects of industrial supervision. 

c. Supervisory training courses, which place considerable emphasis 
on this area, are now being given. 

d. The existence of labor troubles, so frequently blamed on conflicting 
personalities, adds further emphasis to the importance of mental hygiene 
in industrial relations. 

3. A general test of supervisory ability can he used to evaluate the out- 
comes of supervisory training programs. True. The experimental edition 
of t1' “ ^ wn‘5 11 '’ i bv two diffpvpnt corrrMiip' fnr t' is purpose. 
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nificant gains were found in totli cases, especially among the poorer 
supervisors. 

4. Aget education^ and miscellaneous other variahhs are highly imporlani 
factors in good supervision. Generally false. Of all tlic personal in- 
formation examined, only education revealed a relationship above bare 
significance with respect to total scores on the teat. It sliould be pointed 
out, however, that experience was measured in terms of two-year inter- 
vals. Differences which exist between a supervisor of one and a half 
years of experience and one with no experience at all may well have 
been overlooked. 

The hypotheses advanced concerniug criteria for validating the test 
werei 

1. Four members of rnanagement can be found who are sufficiently well 
acqua/inied with any particular supervisor to rate his abilities accurately. 
Questionable. Ratings obtained for this study were not sufficiently 
valid for use as a criterion for determining test item discrimination. 
Differences in standards set by different raters, lack of knowledge about 
the supervisor rated, and logical eiTor (halo effect) concerning relations 
between rating traits all tended to make the obtained ratings invalid. 

2. Industrial experts as a group give reliable answers to the problems 
presented in the test items. True. Two completely different groups of 
experts agreed closely as to the best answers to the items of the test 
(t* = -f" iOl). 

3. Top management and industrial experts agree on what consiiiuies 
good supervision. False. Validity of this hypothesis \vould have 
eliminated the need for two criteria for the validation of test items. 

The hypotheses advanced concerning different methods of scoring 
botli rating-scale and test data were: 

1. Weighted scoring of ratings significantly increases the reliahilily of 
the total rating scores. Generally false. The only appreciable increase 
in reliability, which resulted from the previously described weighting 
methods, was that of correcting for the variability of individual judges. 
This increase in reliability was only significant at the 11% level of con- 
fidence, and was not applicable to most of the data. 

2. Test items which provide five possible responses to each item yield 
more reliable measures of supervisory quality than items which provide only 
three possible responses. False. Identical rcliabllitica were obtained for 
the two types of items. On the basis of this finding, items in the final 
forma of How Supervise? provide for only three possible responses, 
''agree, uncertain, disagree/' 

In addition to the hypotheses accepted or rejected, other observations 
were made for the analysis of the experimental data. Assuming that 
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management-selected auperviaors do reflect the attitudes of top manage- 
ment in their responses, the following observations can be made: 

1. Management and industrial experts significantly disagree: 

a. On methods of handling dissatisfied workers. Industrial experts 
favor transfer; management opposes. 

b. On methods of handling complaints. Management favors stand- 
ardized procedures for each type of complaint; the experts favor the 
recognition of individual differences. 

c. As to the desirability of delegating responsibility to workers for 
improving working conditions. Management opposes. 

d. As to the wisdom of allowing regular rest periods* Management 
opposes. 

e. As to whether a worker should be told what promotions he can 
expect providing he attains a certain level of proficiency. Management 
maintains that these matters of salary and promotion are company 
business which should not be disclosed. 

2. Industrial supervisors, selected by management as best, are not 
fully aware of the importance of human-relations problems in industrial 
supervision. Very few of these problems as presented in the test items 
approached significance with respect to the management-ratings criterion. 
The same items were highly significant with respect to the total score 
criterion. 

From the hypotheses investigated and observations made, we may 
conclude that general factors of supervision do exist and that these 
quantities can be measured. The human-relations aspects of supervision 
are vital and are, of necessity, receiving an ever-increasing amount of 
attention from management. Industrial experts, both theoretical and 
practical, have rather clear-cut ideas about these general factors, In- 
dustrial management tends to be less progressive and seems to favor 
keeping the worker 'hn his place/' rather than encouraging him to become 
interested in ''company affairs.” Management's idea of what it wants in 
a good supervisor seems rather inclined toward negative rather than 
constructive methods of handling supervisor-worker relations. Manage- 
ment is, however, well awai'e of the factual problems in industry and how 
they should be handled. Only on items dealing with the montal-hygieue 
aspects of supervision were there indications of significant weaknesses. 

From this study, a test of the general aspects of supervisory quality 
has been developed. It is believed that this test, How Supervised, will 
prove valuable for selecting candidates for and evaluating the outcomes 
of supervisory training programs, for selecting individuals for direct 
promotion to supervisory positions, and for checking on the quality of 
present supervisory personnel. 

Dnyiyv,'. 1.1/7 Q OTTth^ir IfiAA. 
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It would be presumptuous lor me to pretend to n compi'clieusive 
knowledge ol tlie many and varied raetlioda now being used in the 
selection and placement of personnel in the Armed Services. Many 
groups in both the Army and the Nnvy have been concerned with these 
problems. The civilian Office of Scientific Eesenreh and Development of 
the Federal government oncl certain quasi- and non-governmentnl civilian 
agencies have made contributions, It may be permissible at this time, 
however, to review some of the trends and mention some of the recurrent 
problems. 

It must be recognized that those of us who have been continuously 
working on the problem of selection of service personnel suffer at this time 
from lack of perspective. Wc are too close to the work and therefore 
apt to magnify what will ultimately seem like minor operating difficulties. 
The fact thot most of the data and testa nro at present "classified'' ‘ 
further limits what can he said of them. Virtually nil of the tests, ns 
well ag the research and the investigational studies, have been financed 
by the government, and all results are therefore subject to .strict govern- 
mental control. Government employees and others having access to 
the data we not permitted to report on such results without official 
permission, and no such permission has been sought for any matters 
covered in this paper. 

The importance of the wise use of manpower has probably been 
recognized to a greater extent in this war than at any previous time. 
The examples of waste and extmvagant use of manpower which can be 
cited may seem to deny this statement. The cost-plus type of contract 
does not encourage economy in the use of civilian manpower, and certain 
branches of the military and naval departments have at times deemed 
it wise to reserve or hoard desirable men. The fact still holds, however, 
that in this war more than ever before attention has been paid to putting 
the man in the job for which he is bast .suited, and assigning to special 
training only such men as could absorb the training in the time allowed. 

* A,n. delivered a.t the Cleveland mcclAng o{ the Americivn Statistical Associa- 

tion, Sopttmber 13, 1944. 

^ The term "classifiod," as applied to government documents or data,, gignifica that 
the material is either “restricted,” "confidential,'’ or “secret" — ^i.c., available only to a 
small number of specified individuals. 
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Random solGction, which was not unkixown in the services — for 
example, selecting every other man^ or the first ten or twenty men on the 
muster roll — ^lias been replaced by methods clearly superior. Some of 
the more satisfactory devices are costly both in time and in dollars — for 
example, assigning any individual at random to try his hand at a complex 
task and retaining him only after he lias clearly demonstrated his ability. 
Such methods are being replaced by more efficient and economical means 
of selection which yield demonstrable savings. 

The increase in use of appropriate selection devices is a relative matter. 
There are still to be found able and experienced members of our armed 
forces who believe that, in selecting the fighting man, only the imponder- 
able personal characteristics are of importance and such variables can. 
quiolcly be recognized — ^not measured — by only a few men steeped in the 
tradition of the particular branch of service concerned. Even such die- 
hards, however, are gradually coining to recognize that through scientific 
selection — including test scores, an evaluation of background and train- 
ing, an estimate of certain personality traits, and a recognition of interests 
— men are now being trained better and faster. And fast technical 
training, no one will deny, has been of the essence. The fighting men of 
today must be technicians who nre well trained in the operation and 
maintenance of complex instruments. 

The most striking evidence that the importance of modern methods 
of selection and placement is being recognized is found in the number of 
psychologists employed in the task. The work in the office of the 
Adjutant General, in the Air Surgeon's office, in the Medical Research 
group in Naval aviation, in the Bureau of Naval Personnel, in the Armed 
Sei’ vices Institute, in the projects under the Committee on Service 
Personnel of the National Research Council and its successor, the 
Applied Psychology Panel of the National Defense Research Committee, 
and in the selection and placement of men in the Army and Navy college 
programs — ^all these attest the increasing role being played by measure- 
ment work in the selection and placement of men. Dollars are so freely 
spent these days that cost figures are less significant, but should someone 
have the time and authority to calculate the cost of the technical and 
developmental work being done by the Army and the Navy in selection 
procedures, the figure would be most impressive. The savings which the 
use of tlic techniques so developed have made possible would be even 
more staggering. It must never be foi*goticn that no weapon is better 
than the man behind it — ^and that modern weapons make heavy demands 
on training, and skill, and discretion. 

There are inherent difficulties in finding desirable and economical 
methods for the selection of men destined for success in a war activity. 
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Seldom can all variables he controlled experimentally, Laboratory 
set-ups are frequently not feasible. In field checks, a multitude of 
basically irrelevant factors operate to reduce correlation. The require- 
ments for a given school are frequently shifted for rensona not always 
evident to the research psychologist. Sudden demands from tlie Fleet, 
for example, for more men trained in a particular school may force a 
lowering of the standards for the men taken into the school if, as la usually 
true, the supply of manpower ia limited in quality as well ns quantity. 
The many difficulties characteristic of field study are augmented by the 
not infrequent and drastic shifts characteristic of the Army and the Navy, 
A radio code school unexpectedly closed down may leave unfinished a 
lengthy and costly experiment. The supply of available men may 
suddenly be changed, rendering a change in standards both desirable 
and necessary. 

There ia seldom a clear-cut and unquestioned final criterion against 
which to validate selection procedures. The criterion of successful 
performance under combat conditions of the duty for which the man is 
trained is seldom obtainable. Furthermore, combat conditions are not 
stable. The combat situation is not the same for all men even in a given 
type of work and in the same unit. The best sort of criterion from the 
combat field ia usually a rating or estimate by superior officers; and only 
in rare cases can such ratings, with all their weaknesses, be obtained, 
Because this criterion ia rarely available and can seldom bo obtained in 
any satisfactory fashion, we must accept intermediate criteria. As a 
matter of fact, so called intermediate or non-combat criteria are entirely 
suitable for many tasks. Weeks and months of preparation are necessary 
for a brief period of actual combat. Many service men must regularly 
engage in duties removed from combat. These prosaic day-to-day jobs 
of the technical sergeant, the yeoman, the atorekqeper, the radioman, and 
many others are of great importance in making it possible for us to win 
battles. The skill and zeal they show in their non-combat duties should 
not be underestimated. 

Most technical jobs in the aervices are restricted to men who have 
graduated from formal courses usually called schools. The length of a 
course varies from a few days to several months. To be rated aa a 
torpedoman in the Navy, for example, a new recruit must, after general 
preliminary training, go to a school for torpedomen. To obtain the 
coveted wings of the Naval aviator, one must graduate from the extensive 
aviation training courses. Any economy which can be effected in select- 
ing men who will do well in these schools ia obviously worth while. 
Most selection procedures are designed to pick men who have a high 
probability of success in the school concerned. If scores on a valid 
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peilorrnftncG tost can bo obtain od for the critGriou^ so much the better 
School grades may reflect many traits of the instructor as well ag the 
students, and so are frequently less useful. If the skill of the bombardier 
ia measured by his hits on a target in fifty standardized practice runs, an 
unusually good criterion is available against which to validate the selec- 
tion and training procedures* Valid performance criteria are only rarely 
obtainable. 

If the schools in certain cases have been somewhat out of date, if they 
fail to acJ}iovo proper motivation, if they eliminate men for reasons of 
discipline or personality, the problems of selection are complicated. If 
the schools change and improve as rapidly as possible, as they certainly 
should, the nature of the teats and scores used in selection must be 
subjected to constant study and revision, Selection and training cannot 
be separated; they must be dealt with in most cases as a unit. 

The first logical step in evolving a program for selection of men to 
enter a certain technical course or school is to make an analysis of the 
school curriculum. This analysis is usually made informally and some- 
times intuitively. Tests are then selected which are believed to measure 
the traits deemed essential for success in the school. In selecting the 
men to enter the school, the classification officer should evaluate past 
training and experience along with the test scores. Grades in the school, 
graduation from the school, and ratings obtained are frequently used as 
criteria for the validity of the tests. Many different tests — the verbal 
factor, mathematical aptitude and knowledge, spatial teats, tests of 
general aptitude for electronics, mechanical aptitude, etc. — have been 
given, and various ways of using the results are available, Conditions 
within the schools change, as has been pointed out. Thus there are 
many difficulties in the way of establishing permanent or final methods 
of selection, but the immediate gains made through the use of recom- 
mended procedures have again and again been demonstrated. 

Tests and selection procedures which are effective in selecting men 
from one type of population will not necessarily be equally effective in 
picking men from another type of population. If only college graduates 
have been considered for a particular school, a new selection technique 
may be necessary when men with only a high school education are made 
eligible. A selection program suitable for older men with, considerable 
trade experionce will not necessarily work equally well with men just 
out of school. As the nature of the pool of men from whom selection is 
made changes in its essential characteristics, the testing program must be 
revalidated. For an accurate and complete interpretation of a test score, 
it is usually necessary to know something about the char act eristics of the 
population being tested. 
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An illustration may be taken from tlie Army-Nixvy Coiloge Qualifying 
Test. An item which is successful on this test (in the sense of predicting 
total score on the section) for liigh school seniors from large urban com- 
munities in Iowa and Nebraska will not necessarily be equally successful 
for seniors from small rural locations in Now York state. Consider an 
item in the section on so called common-senso physics, which supposedly 
testa for knowledge frequently obliiinod from otlior sources than the 
class room. One item concerned the long distance transmission of 
electric power. This item was approximately of equal tUfliculty tor the 
two groups — rural and urban — but much more valid for the group from 
rural New York state. Even in the antonym type of items, significant 
differences are found in certain cases — and these items cauiiofc be guessed 
in advance. Why should domneering as the opposite of servile be easier 
and more valid for New York city seniors than those from rural Alabama 
and Georgia? The determination of the angle between the hands of a 
clock at 4:10 is more valid for seniors from urban ccutcvs in Galifortiia 
than those from urban centers in New York, 

These populations of high school seniors from different areas of the 
country and from rural and urban environments arc similar in many ways, 
The shifts in the inductee population with changes in draft regulations 
and with the exhaustion of certain types of eligible men are much greater, 
and cannot be ignored in interpreting teat results. 

There are many techniquea now available to improve the cfliciency 
of testa and selection procedures, Some method of item analysis has 
been widely used by many of the technicians. Tlirough the use of some 
index such as the biserial correlation coefficient, or some estimate of it, 
or certain empirical indices, an analysis of the behavior of a population 
on the individual item can be determined. Non-contributing items can 
thus be eliminated and efficient items retained. The difficulty of the 
item for the population can at the same time be deb^r mined. The 
criterion for the analysis usually is the score on the total test, although 
fin acceptable external criterion may be even better if it is available. It 
is to bo hoped that the comprehensive study of the interpretation of item 
analysis which has been done for the services will eventually be made 
available for wider distribution. 

In meESuring the success of a test for selection, the simple or multiple 
correlation is frequently used, with the test scores on the several measures 
serving as the "independent*^ variables, and the school grades or succesa 
on some performance measm'e or ratings by superiors as the criterion 
being predicted. In those cases where the testa arc used to eliminate the 
potentially unsatisfactory rather than to predict the degree of success, 
critical or "cutting" scores can be used. In such cases tlie empirical 
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results are shown in [i, four-fold table of pass or fail on the teat, and succesa 
or failure in the school. The assumptions underlying the cutting-score 
procedures are more simple and direct than are those where the tests are 
used to predict the entire range from the lowest failure to the top succesa 
in the criterion; on the other hand, the cutting-score procedures suffer 
from all the statistical and practical disadvantages of coarse grouping. 

Certain personality scales and psychoneurotic inventories have been 
used to select men for special attention by the psychiatrist, or to eliminate 
men from further consideration for certain tasks believed to demand 
stable types of personality, such as submarine crews or paratroopers or 
men for certain branches of the intelligence service. In these as in many 
other cases, the selection cost ^ is an item of importance. Too frequently 
the four-fold table of results presents, percentages only, without including 
the original raw frequencies. The following example serves to illustrate 
the importance of this omission. Suppose that, in an experimental 
population of 1,000 cases, a cutting-score is established which predicts 
failure for 60% of the men subsequently rejected, at a cost of only 10% 
of those who are acceptable in terms of the final criterion. If, however, 
only 60 of the 1,000 men were finally eliminated, while 950 were success- 
ful, the teat would have cost 95 (10%) of the acceptable men, in the pro- 
cess of detecting 30 (60%) of those who should be eliminated. The 
problem then is to determine how many normals one can afford to 
eliminate, in order to detect a large proportion of the defectives. The 
answer to such a question can of course be determined only in the light 
of other factors, such as the seriousness of allowing defectives into the 
work, and the availability of men for the work in question. Where the 
unsatisfactory men may ruin expensive, complex, and difficalt-to-replace 
equipment, or endanger the lives of other men, a large selection coat may 
be justified. In other situations where the manpower supply is tight, 
the selection cost must be reduced. 

In some of the extensive work which has been undertaken by those 
working on selection procedures with the armed services, certain methods 
are being followed which may subsequently be judged to have been less 
than perfect. A few of the possible sources of error may be suggested. 
The tests being developed in many cases are still covering a more hetero- 
geneous field than many feel desirable. Relatively pure tests, i.e. 
homogeneous tests, allow themselves to be subjected to a more rigorous 
interpretation. If wc are to believe general reports, we find that the 
Array general classification test contains several quite different types of 

a Afl hero used, "selection coat” refers to the number of men falsely rejected by the 
SGlecbion proceduro. The smaller the number of acceptable men rejected, the lower the 
selectioD cost. 
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subject matter, verbal, mathematics, and spatial, and yot only a single 
score is obtained, The Army-Navy College Qualifying Test used as the 
first screening for over half a million men applying for the Army and 
Navy college programs contained three separate sections, verbal, mathe- 
matical, and science, and yet a single total score served as the basis fov 
the screening. Other illustrations could be supplied. There are good 
practical and theoretical reasons for these complex tests being used, and 
for only a single score being reported; but a good ease can also be made tor 
the use of separate scores for each of the several components. It is 
interesting to note that revisions are now being developed fov more pure 
types of measures in the Army basic battery. 

In a few cases the selection programs use too many similar tests. In 
some cases, fifteen or sixteen test scores enter into the final a election. 
Possibly a reduced program of five or six relatively puro measures of 
meaningful complexes would do practically as good a job. Paper and 
pencil tests of the aptitirde variety have their limitations, and the use of 
a large number of tests gives no assurance that the traits being measured 
are not few in number. Simpler programs of tests are indicated in seme 
cases. 

Another deficiency has been the lack of careful analysis of the results 
from the total testing program used. Such an analyeia would reveal the 
weakness }uat mentioned. Factor analysis, for example, might be 
brought into play to show how many different factors arc being measured 
by the tests employed. Factor analysis techniques, while not extensively 
used in the wartime selection-jobs known to the speaker, have been used 
effectively in several cases. Simple reliability analyses will show the 
undependability of certain of the measures with short time-limits still 
being used. 

A serious error occasionally made is the establishment of selection 
techniques on populations not representative of the population for which 
the techniques are subsequently to be used. In many instances it can be 
demonstrated that the shifts in population are of great importance and 
the results of the tests cannot be interpreted without reference to the 
characteristics of the population being tested. 

The acceptance of defective and unanalyzed criteria as the basis for 
the validation of tests and selection procedures constitutes a serious 
source of error. Ratings, service school grades, scores on performance 
trials — in short almost every available criterion measure — should be 
carefully checked and analyzed before it is accepted. How was the 
criterion measure obtained? Of what factors is it composed? Does it 
reflect the abilities and the skills which the tests were designed to measure 
or which are essential for success in the job? As testing programs become 
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more carefully developed, as more homogeneous or pure types of measures 
are used, the final criterion also must be eubjeoted to analysis and 
purification. In many cases it will be found inadequate and will impose 
a limitation on the interpretation of any validity coefficients based on it. 

The poor conditions under which the tests must sometimes be ad- 
ministered also account for unsatisfactory results. At times the teats 
are administered to the men when they are in a frame of mind scarcely 
conducive to obtaining a normal sample of their behavior. For example, 
at one location scheduling complications led to the administration of 
aptitude teats to men immediately following inoculations, In another 
case, men were tested in the evening of their first day of very strenuous 
active work on a new location. Quite regularly, unselected men are b eing 
tested in groups as large as 600 or 1,000— some experts consider that 
better results could be obtained if groups were smaller. As more and 
more trained testing men take charge, improved procedures can be 
expected. 

Id spite of all these difficulties and all the weaknesses in the systems 
being used, results of demonstrable value are being produced. Rela- 
tively simple selection procedures are being shown to be of value in saving 
time and manpower, in putting the men in the jobs for which they have 
aptitude, and in eliminating the unstable and discontented from certain 
types of crucial work, 

In looking toward the future, the growing intricacies of the machinery 
of war suggest that the country would be safer, if, directly in conjunction 
with the developments and techniques, more time were spent on research 
in methods of selection and training personnel. With new machines and 
improved techniques for the selection and training of men in their use, 
we shall be able to hold our own in any future situation. Psychologists 
and statisticians will do well to establish ever more clearly the gains to be 
obtained by simple but thorough selection procedures and the well- 
systematized use of teat results in the armed forces. 


Received October g, 19^4. 



Adaptbg the Minnesota Rate of Manipulation Test 
to Factory Use 

Guy M. Wilson and Staff 

Personnel Testing Department^ Raytheon Manufacturing Company, 

Newton f Massachusetts 

^‘Rale of movement ia a unit skill and in and of itself cannot be 
improved. Only the techniques of performance can be improved,” So 
states the author of the Minnesota Hate of Manipulation Test.' 

If this is true, the measurement of an operator's rate of manipulation 
should reveal valuable information. It should provide a significant 
ranking of operators on the one item, speed of manipulation. 

At one plant “ the Minnesota Hate of Manipulation Test was included 
in a battery of tests in which it was sought to measure operators as to; 
(1) Intelligence— three tests, (2) Manipulative skill— three tests, (3) 
Special skill— two or three tests, according to the job. It appeared to 
hold its place as a helpful test under manipulative skill. 

In time, however, some questions arose with reference to how best 
to use the test, and how to record the results. Time is always a factor 
in a production plant. Therefore the question — “Could wo save two 
minutes, more or less, by using three trials instead of four?" The 
Manual for the Minnesota Rate of Manipulation Test calls for four trials 
and the final index used is the total time for the four trials. If three 
trials would serve as well, valuable time would be saved. 

As the above question wag studied, another question arose, vk., 
"Would the low score of four trials or three, serve as well as the sum of 
four trials or three, as an index?" If so, time would be saved itv adding 
and a simple, more easily interpreted number could be used as the index, 
For example, the sum of four trials for an individual (see Table 1, which 
follows) might be 235 seconds. For the same individual the low of four 
is 54 Seconds, The individual who sees this smaller figure, readily inter- 
prets it. It means, "One trial required 54 .seconds." 

The statistician knows that regardless of tlie conA’’enience or reason- 
ableness of a change in proccdui'e, the change cannot be made unless 

‘ Zeiglcr, W. A., Mumial for Minncsola Rate of Manipulation Test. Educational 
Teat Bureau, Minneapolis. 

* The Raytheon Manufacturing Company, Newton, Masaachusotts. 
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afcatistica justify the change. In the case of these two questions the 
procedure for study was very simple. 

Table 1 shows in column 1, the ordered arrangement of scores made 
by 63 subjects according to “sums of four.” Column 2 shows the corre- 
sponding sums of three trials. Column 3 shows the corresponding lows 
of four trials, and column 4 shows the corresponding lows of three trials. 

Table 1 

Various SoorDS for Eocb of Sixty-thrcc Factory Workers on the Minnesoto 
Rate of Manipulation Test 


(1) 

Sum of 
Four 
Triala 

(2) 

Sum of 
Three 
Trials 

(3) 

Low of 
Four 
Trials 

(4) 

Low of 
Three 
Trialfl 

(1) 

Sum of 
Four 
Trials 

(2) 

Sum of 
Three 
Trials 

(3) 

Low of 
Four 
Trials 

(4) 

Low of 
Tlirco 
Trials 

177 

124 

40 

40 

22Q 

174 

66 

60 

m 

137 

40 

40 

229 

174 

55 

66 

192 

141 

44 

44 

230 

170 

64 

65 

196 

148 

48 

48 

230 

175 

65 

67 

190 

149 

49 

40 

231 

172 

60 

50 

200 

161 

47 

47 

232 

178 

54 

65 

203 

150 

49 

40 

235 

176 

64 

54 

206 

162 

48 

48 

236 

182 

63 

68 

2 og 

158 

40 

40 

235 

173 

54 

64 

209 

155 

60 

60 

230 

178 

58 

59 

210 

168 

61 

61 

239 

1B2 

57 

60 

211 

159 

52 

53 

241 

183 

58 

59 

212 

158 

52 

62 

243 

181 

■59 

59 

212 

160 

50 

50 

243 

183 

60 

61 

216 

166 

51 

63 

244 

184 

69 

69 

210 

162 

53 

63 1 

245 

182 

59 

60 

216 

163 

53 

53 ' 

24C 

186 

50 

59 

216 

162 

62 

52 

247 

182 

60 

60 

216 

16S 

61 

64 

248 

135 

61 

61 

218 

166 

53 

63 

251 

189 

60 

60 

218 

162 

62 

52 

253 

189 

62 

02 

218 

103 

52 

62 

255 

192 

60 

60 

219 

16G 

63 

64 

255 

101 

60 

60 

220 

104 

54 

54 

255 

184 

59 

59 

221 

107 

54 

55 

255 

194 

61 

62 

223 

171 

52 

55 

256 

194 

61 

61 

224 

170 

54 

55 

255 

193 

63 

63 

225 

100 

55 

55 

258 

197 

62 

65 

225 

170 

65 

56 

261 

196 

64 

64 

226 

168 

55 

65 

263 

199 

64 

60 

226 

171 

55 

65 

280 

219 

GI 

67 

228 

169 

56 

50 
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The present problem is so simple that the mere arrangement in order of 
the itema, almost answers the questions raised. There are 15 or 16 
misplacements in column 2, when compared with column 1, but the mis- 
placements arc smalh 

When column 3 is compared with column 1, tlie story is almost iden- 
tical, There arc IG or 17 miaplticernouts, all very small. In other wordSj 
the low of four trials Avould give almost lire same ranks ns the sum of 
four trials. And the same applies to column 4, the l<jw of three trials. 

If three trials are aa good fts four, or approximately oo, and if the low 
of the trials is as good as, or better than the sum, then we can move on 
to the low of three trials, na the index to use. It will save time, and it 
will be easily understood. 

Comparing columns 3 and columns 4, the low of three trials and the 
low of four trials, it appears that for 43 of the subjects there is a zero 
difference* For instance, the first case, the low of four is 40 and the low 
of three is 40, — in other words, no dilTerence. In 12 of the pairs the 
difference ia one. For instance, the first difference is the twelfth case, 
the low of four ia 52, the low of three is 53. There arc 12 such pairs as 
indicated above whore the difference is one. Thus we have 43 plus 12 
cases in which the difference ia zero or one. The otlier differences are 
as follows: 2 cases with a difference of 2; 4 cuvses with a difference of 3; 
1 case with a difference of 5; and 1 cose with a difference of 6. 

The author of the Minnesota Rate of Manipulation Teat does not 
present the data supporting the reasons for the choice of the sum of four 
trials as the proper index. The sum, of course, ia equivalent on a ranking 
basis to the average. An average woxild give a lower figure, and, there- 
fore, a more easily comprehensible index. On theoretical grounds, and 
in the absence of aupporbing data, it may be easily argued that a low ol 
four trials ia better than an average of four trials. In the field day event, 
such as the pole vault or the high jump, the beat score made is taken, 
not the average. 

It is evident, from a casual study, that the correlation between any 
two columns in Table I ia very high. The correlation between columns 
3 and 4, for instance, using the product moment formula, ia + .97. The 
only negative product in the products column ia ^3; there are four 
zeros; the other 58 products are positive. 

Correlating ^ the other columns of Table 1, gives the following values 
foT r— columns 1 and 2, + '98G; columns 1 and 3, + .952; columns 1 and 
4, 4- .968; columns 2 and 3, + .939; columns 2 and 4, + .968. 

It was finally concluded in this partioiilni’ factory to substitute the 
low of three trials for the aum of four trials as the index of performance 

* Correlations figured by Rachel Lounsbury, 
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for the Minnesota Rate of Manipulation Test, It is more convenient; 
it ia more easily understood by some one to whom an explanation of the 
score is being made. It, probably, is an equally good index, although 
the proof of this last statement would require checking by more cases 
than used in this study and correlating with outside criteria. But this 
study is sufficient to raise the question, and, probably, to justify the 
change to a more convenient and understandable index.'* In a busy 
factory, time and ease of understanding are important factors. 

The above discussion may lead the reader to suspect the use of local 
data for the establishment of local norms. This is correct. First inter- 
pretations were based upon national or published norms. As soon as 
sufficient cases were at hand to fill in what appeared to be a typical 
distribution, local norma were tentatively established. If confirmed by 
later distributions, they were then used with reasonable confidence. 
Constant checking of one’s data is necessary in any case and such check- 
ing sometimes reveals desirable local adaptations. 

Racetited Orfober 7, 1944. 

‘ See also Jacob Tuckman; A comparison of norms for the Minnesota Rato of Manip- 
nlation Test. J. Appl. Payeh,, 28; 121-12B, Apr. 1944. 



The Horn Ait Aptitude Inventory 

Charles A. Horn and Leo F. Smith 

Rochester Imlitule of Technology, Rochester, New York 

It is the purpose of this paper to describe tlie Horn Art Aptitude 
Inventory. This aptitude test has been developed by the faculty of 
the School of Applied Art of the Rochester Institute of Technology '■ 
during the past eight years and has been used with freshmen entering the 
Art School at this institution and with groups of high school art students 
competing for Art School Scholarships. 

Construction 

After having studied and experimented with various art tests over a 
period of years, the Art School faculty wore of the opinion that certain 
qualities essential to success in the art field wore not being satisfactorily 
measured. The problem of obtaining clues to these qualities in students 
was the objective in designing this test. 

The test is divided into two distinct sections; (1) Drawings of Lines 
and Shapes, subdivided into two parts; (A) Scribble Exercise, and (B) 
Doodle Exercise; and (2) Imagery,* 

In section 1 (Part lA) the Scribble Exercise is designed to give the 
student confidence that he can draw a reasonably simple shape or picture. 
In this part he is asked to draw twenty different items such as a book, a 
fork, etc. and is given a limited time, varying from two to six seconds, 
in which to make each drawing. The total time required for administra- 
tion of this section is approximately five minutes. 

The Doodle Exercise (Part IB) ia designed to obtain examples of the 
student’s quality of lines, ability to follow directions, ' originality and 
compositional sense. In this part he is asked to draw various lines and 
shapes such as rectangles, triangles, circles, etc. The total time required 
for the administration of this section ia approximately five minutes- 

The Imagci'y Section (Part 2) ia designed to obtain an indication of 
the scope of the student’s interests, and the fertility of his imagination 
with respect to the number of ideas and the ability he exhibits in present- 
ing these ideas. In this section there are twelve rectangles 2% inches 

^ Formerly Eoshestcr Athenaeum and Mechanics lustituto, 

* The teat and manual of diteotiooa ia distributed by Educational Reaearcb Office, 
Eochestor Institute of Technology. 
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by 3}^ inches in which certain key lines are presented and the student is 
requested to use these lines as ‘‘spring boards” and construct sketches 
Tvhich are suggested to him by the key lines. Figure 1 shows two 
pictures which have been constructed using the key lines given. The 



Fig. 1. Sample pictures B and C drawn on basis of key lines shown in A. 


total time required for the administration of this section is approximately 
forty minutes. 

Interpretation and Scoring 

In the manual of directions now being prepared for use with this test 
examples of excellent, average, and poor papers are being included. 
This will enable a person not trained in art to have a basis upon which 
1^0 make judgments. There arc several standards, however, which the 
members of the Art School faculty have identified as important. These 
are: 

1 . Order: Are the items so placed on the sheet that they fill it pleasingly 
and indicate that the student has a sense of order, or has the student 
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cramped the items so that the entire page was not used? In other words 
has the work been well planned for the vsize sheet which us being used? 

2, Clarity of Thought and Preseniaiioii: Are the sketches made with 
a clean line so that there are no crnsiireH or fumbling? Are the items 
recognizable, that is, if the student meant to draw a tree docs the drawing 
reasonably resemble a tree? What ia the quality of the line used? Is 
it continuous? Is it broken, cramped, or bumpy or is it graceful and 
smooth? 

3, Colon Is there a conBistcntly even tone to the drawingB or does 
the sheet appear spotty, i.e. is there evidence of imcvcn pressures' Are 
the items smudged, fuzzy or erratic in their line quality? 

Inlcrpretmg the Scribble Exercise I-A: The directions provided with 
the scoring manual are as follows: 

Open up the folder to page 2 and fold the top sheets back. Lay the 
tests side by side on a long table so tliat you have an over-all view of the 
work of all the papers. 

Scan up and down the papers quickly keeping in mind tlic standards 
of order, clarity and color. In this manner tlioso which arc "excellent^^ 
and those which are “poor” may be readily identified and it will be noted 
that this generally leaves a group wliich may be considered ^'average. 

If it is desired to obtain a more precise judgment of rank than ^^exccllont/^ 
'‘average,'^ and "poor/' by use of the criteria which have already been 
suggested, divide the "average” group into "good,” "average,” and "fair ” 
This then gives five categories: "excellent,” "good/* "average,” "fair,” 
and "poor.” 

It is considerably more difficult to break up the "average” group 
into three sub-groups than it is to judge the extremes. It has been found 
that a lay person, without any training in art work, can judge the ex- 
tremes with as great accuracy as can competent art teachers, but a lay 
person experiences somewhat more difficulty when efforts are made to 
divide the "average” group into the three sub-groups. 

Interpreting the Doodle Exercise l-B: One important student trait 
often identified here ia originality. For example, has the student done 
the usual thing and divided the square and rectangle in n symmetrical 
manner, which would indicate conformity or triteness, or has he spotted 
the smaller square off center. Similarly, has he broken up the rectangle 
exactly in the center of the sides or has he done the unusual, i.e,, broken 
it up in an asymmetrical manner? 

Interpreting the Imago^y Section — 2: The criteria which have already 
been mentioned should be kept in mind but in addition the following 
should be noted: 
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L The fertility of imagination aa indicated by the number of ideas 
presented, 

2. The scope of interests. Are these limited to one particular type 
such as landscapes, people, sea scenes, or does the student have a 
wide range of interests? 

3. The clarity of mental image. 

4. Color — Does the student utilize an outline only or does he shade 
much of his work? 

5. Design — Does the student consistently use abstract forma as 
contrasted with the litoral or naturalistic? 

The junior author of this paper (L. F. Smith), who is a member of the 
Educational Research Office and has had no art training, has scored two 
groups of these inventories employing the technique of spreading the 
teats aide by aide on a long table and identifying those which are ''ex- 
cellent,^^ "average” and "poor” on a subjective basis. Then, using the 
criteria which have already been suggested the '^^average” group has been 
divided into "good,” "average,” and "fair.” 

Table 1 

Reliability of Scoring Horn Art Aptitude Inventory 
[CocfUDjcnta of correlation between ratings given by two Art School Faculty members 
(Ai and Aj) and member of Educational Research Office (E,R.O.)] 



Group 1 * 


Group 11 



Ai Ai 

E.R.O. 

A. 

E.ll.0, 

Ai 

— M 

.80 

A, - 

-^9 

As 

E.R.O. 


.83 

E,R.O. 



• Group I consisted of 21 Art School students who took this test in the Fall of 1939. 
** Group II consisted of the Scholarship Class of 20 high school seniors who took 
this teat during the Spring of 1944. 


Table 1 illustrates the reliability of ratings for these two groups. 
In Group I two Art School faculty members and the junior author 
independently scored 21 test papers of regularly enrolled art school 
freshmen. In Group II one of the Art School faculty and the junior 
author independently scored 20 teat papers of high school seniors com- 
peting for fellowships in the School of Applied Art. 

Validity 

Two studies of validity have already been made and others are in 
progress. In the first study all of the students who graduated from the 
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Art School in 1041, '42 aiirt *43 rated hy four Art Scliool faculty 
members on their success in the thiTe year cDurse. Horn tost scores 
of these fitudenls (N = 52) were then correlated with tlie nvcviigjo of the 
faculty ratings. The Potivson praduel-momonl (uu'relaliou heUveen the 
Horn test scores of those stucleuls uud Llio uveruge faculty rating was 
+ ,53, 

In the second study the 30 liigli sclioul seniors (‘urolhal in the Fellow- 
ship Competibiem Classes of 1943 anil 1044 were rali^l on ihoir success 
in this class by four Art School faculty lueinbers. The nova test had 
been given to all of these Btvidcnts at the iK'ginning of tlic class and the 
prodiict-momeut correlation hetweeu their scores and the average faculty 
rating of success was + ,6C. 

That the Horn Art luvenloiy nKuisiires soinclhing oihc]' than in- 
telligence is indicated by tlic ])ro(Uicfc"nioinont coi'relaiion (jf only + .15 
between tho Inventory test scores for the ciassos of 1941, '42, and ^43 
{N = 52) and their American Council on Kdneatiun Psychological 
Examination vseoves, That this inventory is of more value in predicting 
success in the three-yoar art course than is the AX'.E. intolIigGnce test 
is indicated by the prodiict-inomcnL correlation of -I- .28 between the 
intelligence test scores and the average faculty rating of sucecs.s for these 
Bamc three classes. 

Summary 

1. The Horn Art Aptitude Inventory has been in the process of 
development for a period of more tliaii ciglii yoai’s at ilic lloclicster 
Institute of Technology. 

2. The unique features of this Inventory are; (A) The student is 
required to make reasonably simple drawings which illustrate tl\c quality 
of line he employs^ his appreciation of proportion, and his compositional 
sense, and (B) the student is given exercises which provide an indication 
of the scope of his interests, the fertility of his imagination, and the 
ability to depict pictorially ideas which occur to him. 

3. The scoring is still someAyhat subjective but correlations between 
the ratings given test papers by Art School faculty members and a lay 
person vary from ,79 to .86 for two cliffereiit groupH of stiideuts. It 
appears that a lay person with no training in art can score those papers 
as adequately as members of the Art School faculty, 

4. The producfc-moiYient correlation between tho Horn Inventory 
test papers and faculty rating of success of the 52 graduaies of the classes 
of 1941, '42 and A3 in a three-year full-time program was -h -53. The 
correlation between test scores and success in two much shorter Scholar- 
ship Classes wag + .60 (N = 36). 
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5. The correlation between scores on the Horn Inventory and A.C.E. 
intelligence test scores is low (+ .15). This Inventory is of more value 
in predicting success in the three-year Art School course than is the 
A.C.E. intelligence test as the correlation between the latter and course 
success rvas + ,28. 

Additional studies arc being carried on in the effort to make the 
scoring of test papers more objective and to determine the effectiveness of 
this as a predictive instrument for different age groups, It is believed 
that the results of these studies will Improve this instrument which has 
already been of value in one institution, 

Receiv^ September 18^ 



A New Method for the Administration of Individual 
Intelligence Tests 

Raymond Corsini 

/uburij. Prison, Aufcurrt, Wcw Forfc 

Most test manuals and books ou testa and meaaxirements agree 
rather well on tlic general methods of conducting an individual intelli- 
gence test (1) (2) (3) (4) (5) (6) (7) (8) (D). Termnn and Merrill (7) 
Buramarixe in three directives; "(1) Standard pioccdures must be followed, 
(2) the child’s best efforts must be enlisted by the establishment and 
maintenance of odequato rapport, (3) responsCvS muat be correctly 
scored." 

However, there is n lack of dircetions in any manual for the actual 
administration of on individual tost in terms of throe variables; (1) where 
to place subject in relation to examiner, (2) where to keep test materials 
during the coume of the examination wlicn not in actual use, and (3) how 
ranch of the behind the scene actions of the exarpiner are to be permitted 
to be seen by the subject, 

The purpose of this article is to give a description and evaluation of 
various ways in which these three variables are met by examiners, plus 
the description of a new method for administering individual tests which 
appears to tac superior to any in present use. 

Placement 

Generally the subject (1) sits at the right hand side of the examiner’s 
desk, (2) or faces the examiner behind a table. The second method is 
more comfortable for the subject if he has any writing to do, or if he has 
to handle any material. 

Materials 

Some examiners stow all naatcrials in a desk drawer. Some keep 
materials in small boxea, within a larger box which in turn is put on. the 
desk, Some scatter materials loosely over the desk or tabic. Some 
examiners keep all maicrial out of sight except when in use. Others 
permit material to acoumulatc on the desk or on the table. 

The best method appears to be that wliich is most convenient for the 
examiner and which permits no wasteful searching around for an article. 
Generally, it seems best to handle any items so that they will not distract 
the subject, 
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Scoring 

There are four popular \Yaya to ecore the test blank. Two are done 
in the subject'a sight, two are done out of sight. 

Method ''M' scores openly on the desk or table. 

Method "B’' scores openly but makes a check mark to indicate cor- 
rect, and a check mark with a loop to indicate wrong. 

These methods have the good point that they help keep up rapport 
in that nothing is hidden. Method "A/' however, is poor because sub- 
ject tends to change or add to his answer on getting a minus, or may even 
demand why he is being scored incorrectly. 

Method may fool some very dull subjects, but generally subjects 
know when they arc wrong, and realize that some hidden procedure is in 
operation, This method tends to cause unrest on the part of the subject. 

Methods and ''D*' involve scoring the protocol out of sight, In 
method the best of these four methods, a visual barrier made 

either from a folder or made of more permanent material is interposed 
on desk or table between subject and psychologist. Behind this barrier, 
the psychologist prepares materials, and scores the protocol. The 
advantage is in not letting the subject see what he is being marked, but 
its disadvantage lies in its abruptness and the *^insulV' to the subject. 

Method involves folding the test booklet into quarters, keeping 
it flat on the bottom of a desk drawer^ together with stop watch and 
manual, and attempting to mark the protocol in an unobstrusive manner 
with a stub of a pencil. This method, to the author, seems the worst of 
the four, since it soon becomes obvious to the subject that the examiner 
is rending from a book in the desk, and is slyly making notes meanwhile. 

The New Method 

For some lime the author of this article has followed a novel procedure 
in administering individual tests that appears to possess aupeiior ad- 
vantages to any of the combinations of the three general variables so far 
described, 

Following the interview, the subject is asked or is told to take an 
individual tost. A table, 18" X 30", is placed parallel to the pull-out 
leaf on the right hand side of the examiner's desk. The subject sits 
behind the table, facing the examiner. From the subject's point of view 
a box is then placed on the upper right hand corner of the small table. 

This arrangement allows the subject to sit behind the table, with his 
feet under it. He has plenty of space to write. The examiner makes 
his notations on the pull-out leaf of his desk. 
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Ab aoon as both arc settled, the examiner removeji the test manual 
and a teat protocol (blank for scoring responses) from the box. This 
immediately indicatcH the function of the box to the subject. The 
znanUfll is placed on the desk in view of the mibjcct l>nt too far away for 
him to be able to read from it. The protocol is placed on the pull-out 
leaf in front of the box, therefore out of sight of the Hubject. The box 
acts ns a visual barrier, but in so natural a manner that ib cannot disturb 
a subject since Im accepts the box as an iuUigval .part of the examination 
procedure. 
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Whenever any test materials are needed, such as blocks, cards, 
tissue paper, scisaois, form boards, etc., they are taken from the box, 
quickly and simply, since they are found in various compartments of the 
three shelves or sections, and immediately after use are returned to their 
proper places. Everything is instantly available, nothing can accu- 
mulate, and since there is no searching for materials the examination 
proceeds swiftly and efficiently. 

The author has had two such boxes constructed, one for the Wechslcr- 
Bellevue and one for the Stanford-Binet. Of course, the arrangements 
of the partitions vary to accommodate different materials. The boxes 
are uniform in size, approximately 5" X 10'' X 12". Each box consists 
of three elements or shelves, stacked on top of each other, hinged at the 
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back, and locked to each other at the front by a simple catch. The top 
clement has ft hinged cover.* 

At the conclusion of the test, the manual is replaced, and the box is 
put a^Vfty, ready for the next administration. 


Summary 

1. There is no uniformity of individual test administration with 
respect to these variables : a. Placement of subject and examiner; h. 
Maintenance of material during the course of the examination; and c. 
Scoring the test blank. 

2. A new method of administering individual tests is described which 
possesses the following advantages: a. Is standard; fe. Is fast, efficient, 
and simple; and c. Reduces subject-examiner friction. 

Received September 22, 1944, 
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The Relationship Between Scholastic Achievement and 
Personality Adjustment of Men College Students 

George R. Griffiths 

DiDision aj Personnel JUnnojenieiil, U. S, Maritime Ceininiasion 

Personality is often considered an AUadin’a lamp to achievement, 

If one has "personality,” success is inevitable, If one has no "per- 
Bonality/' he may ns well resign himself to his fntc. Fortunately, such 
an attitude is fast being displaced by a scientific appreciation of the true 
nature of that phantom "peisonalily.” 

Broadly speaking, personality consists botli of a person’s reactions 
and responses and of the influence that pemon wields over others. Space 
lirnitationg preclude a lengthy discourse on the nature of personality, 
but let us take a moment to view some of its main factors or traits. We 
can do no better than to refer to Allport’a table of personality traits (1), 
Listed concisely, they are: 1. Intelligence; 2. Motility; 3. Temporament; 
4, Self-expression; and 5. Sociality. 

Some authors add a sixth, ‘physique. Gaakill (3), over a ten-year 
period, made a survey in his beginning psychology classes of the traits 
most desired in a mate. Seventy per cent ranked health first; forty-five 
per cent ranked intelligence second. Ilia list of the elements of per- 
sonality is as follows: 1. Intelligence; 2. Social adjustment; 3. General 
characteristics of overt behavior; and 4. Physical characteristics. 

A scientific analysis of personality, its traits, and its relationships, 
should proceed by the examination of specific factors and specific rela- 
tionships. The problem here undertaken is to determine whether or 
not there is a significant relationship between personality adjustment 
and academic achievement. 

Previous Investigations 

Those who blandly state that intelligence does not correlate with 
personality are ignoring the fact that intclligonco is an integral part of 
personality. What these persons do mean, however, is that intelligence 
does not correlate highly with various other personality traits. High 
intelligence, according to Strang (9), is ordinarily associated with a 
pleasing personality, since intelligence involves insight, the ability to see 
relationships, and the capacity to learn. 
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A brief aumraary of various other pertinent studies may serve to reveal 
the natul'G and findings of previoua investigations. A substantial posi- 
tive relationship between intelligence as measured by standardized tests 
and personality as judged by interviews and ratings was f6und in Uni- 
versity of Iowa studies (2). However, when scores on personality teats 
and questionnaires arc used rather than the results of observation, the 
coefficients of correlation range around zero (between + .20 and — .20). 

Terman (10) found that superior children (moat of them with IQ^a 
above 140) are more emotionally stable and more socially adequate than 
unaelected children. One study (4) showed a tendency toward small 
negative correlations between scores on neurotic inventories and scholar- 
ship. On the other hand Thuratone found, iii applying his Personality 
Schedule to college students, that no relationship existed between in- 
telligence and "neurotic tendency,” but that the less well-adjusted 
students tended toward slightly higher academic grades (6). There is a 
tendency for higher learning performance to be associated with sub- 
misslveneas as measured by the A-S scale (5). 

Stagner's findings (7) were that unstable and maladjusted students 
do leas well in proportion to their intelligence than do stable persons; 
that introverts earn i)roportionately higher marks; and that unfavorable 
scores in emotionality and self-sufficiency are associated with lower 
achievement than would have been predicted from intelligence alone. 
Strang (9) reports a lack of relationship between scholarship and various 
measures of introvorsion-extroversion. Finally, reference should be 
made to a study by Stcdinan (8). She found that the average grades of 
pupils with certain health defects were only 75% those of healthy pupils. 
However, of her 450 cases, the healthy group numbered only 39. 

Occasionally studies appear to show definite relationships between 
personality and scholarship. Others seem to be contradictory. The 
result is that there has as yet been no clear definition of the connection 
between scholarship and personality. 

Study at Ohio University 

This study was iindcj‘takcn with Freshman men at Ohio University to 
discover whetlier there is a relationship between scholastic achievement 
and, personality adjiisiment, employing the statistical technique, the 
probable error of the dilTcrcncc between means. The measure of acho- 
lastio achievement used was the first semester point-hour-ratio; i.e., the 
total number of semester hours of courses carried divided by the number 
of points earned, where A = 3, H — 2, C = 1, and H = 0, The Bell 
Adjustment Inventory was used as a measure of personality adjustment. 
This Inventory measures four types of personality adjustment: health, 
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home, social and emotional, yielding scorca fov cncli area and a total, 
composite score, (Strang is firm in her iisHcrtioii of the unreliability of 
auch pcraonality questionnaires (9). Her argument is based mainly on 
the fact that they fail definitely to differentiate psychiatric patients. 
She may be right; that is not the problem here.) 

In this study of peraoniUity and scholastic nehievoment eevcrol 
different viewpoints wore utilized. The first aiiproncli was to compare 
with various other groups those men placed on scliolnatic prolxition at the 
end of their first aemcater for earning a point-liour-ratio of less than 0.6. 
The other groups are; first, a group matclied person for person witli tha 
Probation group in college ability scores; i.o., scores on the Ohio State 
University Psychological Examination (Matched grouj)) ; second, a group 
selected at random (Average group); and tiiird, a group matched indi- 
vidually rvith college ability scores ns high as those of the Probation 
group were low (Excellent group). 

* Tabic 1 


CompitriBon of Probation Grou\i with Other Grovips in CoUt'go Ahility, 
Gradea, and Porsoiiality 


Group 

N 

CollCRO 

Ability 

Vorconbilo 

Pointr 

llour- 

Kalio 

Tolai 

Pcrfionftlity 

Score 

Probation 

40 

21.3 

0,2(10 

30.2 

Matched 

40 

21.3 

1.023 

30.4 

Avorago 

40 

40.8 

1.410 

37.8 

Excellent 

40 

78.7 

1.703 

34.8 


Statistical comparisons of these groups in college ability, grades, and 
personality (as mcetBUred by the Bel! Adjustment Inventory) are presented 
in Table 1. All figures are arithmetic mearua. A low score is the favor- 
able score on the Bell Adjustinent Inventory; so the lower the mean, the 
better. Probable errors of the difference between means were computed 
as a measure of the aignificance of those differences. It is generally 
accepted that to be statistically significant the difference should be at 

Table 2 

Probable Errors of Mean Differences in Pcisonality of Probation and Other Groups 


Differmeo 

Groups of Means P.E. (Diff.) 


Probation and Aveiago 

1.4 

2.367 

Probation and Matched 

2.8 

2,163 

Probation and ExccUciit 

4.4 

l.QQd 
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least four times its probable error. The difference in mean personality 
geoves and the probable errors are shown in Table 2. In no instance ia 
the difference significant since the probable errors are too great. In the 
comparison of the Probation men with Excellent men the greatest 
difference is found; but it ia only 2.2 times its probable error. Appar- 
ently, men experiencing acholaatic difficulty exhibit no significant per- 
sonality differences from persons of superior college ability. 

Another comparison made was of the Bell Adjustment Inventory 
scores of Probation men and men matched as nearly os possible with 
point-hour-ratioa as high (Opposite group) as those of the Probation 
group were low. Table 3 includes scores of these two groups in college 

Table 3 


Comparison of Probation and Opposite Groups in College Ability, 
Grades, and Personality 




College 

Point- 

Total 

Group 


Ability 

Hour- PerBonnlity 

N 

Percentile 

Ratio 

Score 

Probation 

40 

21.3 

0.2G6 

39.2 

Opposite 

40 

S5.3 

2.010 

37.4 

ability,, grades, and personality. 

The difference of 1.8 between the mean 

personality scores is 

clearly not significant, 

aa the probable error of this 

difference is 2.009. 

In other words, men 

on scholastic probation are 

approximately equal 

in personality adjustment to men with 

superior 

scholastic records. 


Table 4 



Comparison of Groups Divided on the Basis of Personality Scores 




Total 

College 

Point- 



Personality 

Ability 

Hour- 

Group 

N 

Score 

Percentile 

Ratio 

Very unsat. 

37 

66.9 

42.3 

1.018 

Unsatis. 

122 

48.8 

39.6 

1.001 

Average 

77' 

38.5 

48.0 

1.198 

Good 

112 

17.5 

49.0 

1.169 

Excellent 

17 

7.1 

60.7 

1.263 


A third approach was made by comparing groups of men divided on 
the basis of their total scores on the Bell Adustment Inventory. Five, 
groups are thus differentiated; very unsatisfactory, unsatisfactory, 
average, good, and excellent. In Table 4 are presented averages in 
personality, college ability, and grades. The difference in point-hour- 
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ratio between the very unaatisfactory- group and the excellent group ia 
0.245, in favor of the excellcnb group. The probable error of this differ- 
ence is 0.1187. Since this figure is less than onc-half the difference, the 
difference between the means of theao two groups ia not statistically 
significant. Apparently, mea studetita scoring very unsatisfactory on the 
Bell Adjustment Inventory do not reveal ficholnatic tiendB significantly 
different from those scoring excellent in personality. 

The fourth attack on the problem was a comparison of two groups 
selected on the basis of health scores in the Bell Adjustment Inventory. 
This viewpoint waa suggested by tho study of Steelman cited above. 
Men scoring very unaatisfactory in health were separated from those 
scoring excellent. Table 5 contains their mean scores in personality, 


Table 5 

Mean Scores of Groups Divided on tho Basia of Health 


Health 

N 

Total, 

Personality 

Score 

Oollcgo 

Ability 

Pcrccntilq 

Point- 

Hour- 

lUitio 

Voryunsat. 



60,3 

1.133 

Excellent; 


mSM 

66.0 

1,441 


college ability, and grades. As an interesting Bklelight, the grades of 
those with very unsatisfactory health were 78.C% of those in excellent 
health. Although based on smaller samples, this appears to be in line 
with Stedman*s finding of 75%. However, the differcnco between the 
mean point-hour-ratios is 0.308, which is only 2.3 times its probable 
error, 0.133, and, thevofore, not significant. Wo can conclude, then, that 
men scoring very unsatisfactory in health are not particularly inferior in 
acholastic achievement to, although a difference appears to exist in favor 
of, those in excellent health. 

A fifth comparison made was of the grades of men scoring very un- 
satisfactory and men scoring excellent in emotional adjustment on the 
Bell Adjustmeat Inventory. Table 6 contains mean personality scores, 


Table 6 

Mean Scores of Groups Divided on tho Basis of Emotional Adjustment 


Emotional 

Adjustmonb 

N 

Total 

PorsonaUty 

Score 

Collcgo 

Ability 

Percentile 

Pomtr 

Hour- 

Rati(? 

Very unsat. 

40 

58.0 

42.58 

1.144 

Excellent 

40 

14.0 

56.66 

l.UB 
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college ability percentilea, and point-hour-ratios of these two groups. 
The difference in point-liour-ratios le 0.026 in favor of the very unsatis- 
factory group, This is the only difference in the study which appeared 
contrary to expectation. It corresponds, however, with the tendency 
Thurstone found in studies mentioned above. As its probable error 
amounts to 0.1001, no importance can be placed on the difference. The 
difference is also the amallest revealed in the study as it is but one-fourth 
its probable error. 

A final analysis utilized comparison of the highest and lowest deciles 
in college ability to see whether differences in pei’aonality might exist. 
This ia more nearly a compariBon of personality with intelligence. Mean 
scores for these two groups are contained in Table 7. In this case the 


Table 7 

Mem Soorea of Group, ‘i Divided on tho Basis ol College Ability iS‘corea 




Point- 

Total 

Group 


Hour- 

Personality 

N 

Ratio 

Score 

Lowest 10th 

39 

0,633 

42.7 

Highest 10 bh 

38 

2.002 

37.7 


difference in personality scores ia 5,0 in favor of those in the highest decile. 
This differejice is 2.1 times its probnble error and, hence, not great enough 
to be accepted as of statistical significance. The only conclusion that 
can be drawn is that men in the highest and lowest deciles of college 
ability do not show a marked difference in personality. 

Results and Conclusions 

The question of whether there are valid relationships existing between 
scholastic achievement (poiut-hour-ratio) and personality (Belt Ad^ 
justment Inventory) has been examined here from several different points- 
of -view, The results are these, briefly; 

1. Men clearly in scholastic difficulty, having been placed on academic 
probation, are not very much inferior in personality adjustment scores 
to men of superior college ability (Tables 1 and 2). 

2. Men students with bvilfiant scholastic records are no better 
adjusted in personality than men of lowest academic achievement 
(Table 3). 

3. An analysis of men with very unsatisfactory personality scores 
shows no significant difference in their grades from those with excellent 
personality adjustment scores (Table 4). 
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4. Sciutinizing a comparison of men with very imaatisfactory health 
ecorea with men of excellent health scores reveals a small but not signifi- 
cant difference m favor of the excellent group (Table 5). 

5. Men with very unsatisfactory emotional acljustinent scores tend 
toward higher grades than men of excellent emotional adjustment scores, 
but the difference is not significant (Table 6), 

6. There ia no very great difference in personality scores evident 
between men in the lowest decile of college ability (The Ohio State Uni- 
versity Psychological Examination) and men in the highest decile 
(Table 7). 

In every case but one there ia such a difference as suggests some 
degree of positive correlation between scholastic achievement and per- 
sonality. But as a difference, to be accepted as statistically significant, 
must be at least four times its probable error, the differences found are 
not large enough to be valid. In these analyses the differences ranged 
from 0.25 to 2*3 times their probable errors. Nevertheless, it aeems 
reasonable to conclude that the consistency of these differences, even 
though they are small, is in itself important. It may mean that our 
psychometric techniquea, especially personality measures, are in need 
of refinement. Then, too, it may mean that actual differences do not 
exist, however logical it is to expect them. In any event, no conclusions 
can be safely drawn until further research is conducted with more positive 
results. 


Suggestions for Further Study 

Further study along two lines might be productive of useful results; 

1. The difference in mean personality scores between the Probation 
and the Matched groups in favor of the latter (Table 1) hints that per- 
sonality factors may be present to influence the difference in grades of 
persons of equal college aptitude. The causes of diverging academic 
records of persona of approximately equal jnental ability should be 
investigated to determine whether personality factors are present, 

2. Since college students are highly selected, nearly all being above 
normal in intelligence, studies should bo made where gi'oups definitely 
below average can be compared with those high in intelligence. 

Recmed SO, 19^. 
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Negro-White Attitudes Towards the Admhiistration of 
Justice as Affecting Negroes 

F. C. Sumner and Dorothy L. Shaed 
lloivard University 

It was proposed in this study to measure 11 ic degree of unanimity in 
attitudes of Negroes and whites both at the college level and at the adult 
level with respect to the administration of justice as affecting Negroes, 

Method 

A questionnaire was devised consisting of 56 statements taken from 
the spontaneous conversations of Negroes. The respondents were 
instructed to read each statement and to indicate their reaction with a 
circle in one of the following six ways; 

If you feel that the statement is absolutely true, draw a circle around 
the symbol T 4 , 

If you feel that the statement is more true than false, draw a circle 
around the symbol T 3 F 1 . 

If you feel that the statement is about equally true and false, draw a 
circle around the symbol TjFj. 

If you feel that the statement is more false tlian true, draw a circle 
around the symbol TiFj. 

If you feel that the statement is absolutely false, draw a circle around 

F4, 

In case you do not understand a statement, draw a circle around the 
question mark. 

Personal information was requested such as sex, ago, race and whether 
or not one had had any court experience (By court cximrieucc was meant 
any experience from being merely a “spectator” to being a judge). It 
actually turned out that the attitudes of those with court experience 
differed very slightly from the attitudes of those without court experience. 

Of the 1,099 persons replying to the questionnaire' there were 24G 
white college students of whom 176 rvere male and 70 female; 660 Negro 
college students of whom 261 were male and 399 female; 193 adults of 
whom 42 were white and 151 Negro. 
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The 906 college students replied from the following colleges: 


Univeraity of Illinoia 
Univcreity of North Carolina 
Univeraity of South Carolina 
UiiivorBity of Florida 
Weat Virginia State Collcgo 
Howard Univeraity 
Univeraity of Illinois 
TenncBsee State College 
Florida A, and M- College 
Alcorn A. and M. College (Miss,) 
State GollegCj Orangeburg, S. C- 
Virginia State Goilego 

Negro college atudenta starred. 


60 (M44,F22) 
90 (M81,F 9) 
64 (M31, F23) 
30 (M20, F16) 
69* (M 36, F 5i) 
48* (M 23, F 22) 
13^(M 0, F13) 
97* (M 26, F 71) 
04* (M 49, F 46) 
77* (M 53, F 24) 
105* (M 27, F 7fi) 
137* (M 45, F 92) 


The 193 adults who replied lived in the District of Columbia. 

In reducing the great mass of raw data to manageable terms the 
following formula was devised and designated the True-FalBe Index 
(TF Index) of a group in respect to a particular statement: 


{T, + T,Fy + - (Mnn + TxF, + FQ 

N (= total number of replies to the specific statement) 

For example, the 174 white college males replying to Statement No, 
27 (Judgres are entirely free of racial prejudice) distributed os follows: 

T4 TbFi T 2F2 TiFb Fi 

9 35 24 55 51 

and the TF Index is 


or 32% - 68% = - 36%. 


(9 + 35 + 1 ) (y + 55 + 5l) 
174 174 


This obtained TP Index means that 36 per cent voted against the pro- 
position over and above the remaining 64 per cent who were tied between 
accepting and rejecting it. 

TF Indices vary between + 100 (unanimous belief of the group in the 
truth of a statement) and — 100 (unanimoua disbelief of the group in the 
truth of a statement). When TF Indices arc + 100 to + 34 inclusive, 
they indicate a definitely positive reaction on the part of the group in qs 
much as two^thirds or more of the group accept the proposition; when 
TF Indices are + 33 to - 33 inclusive, they indicate a definitely mixed 
reaction on the part of the group in as much as two-thirds or more of the 
group are tied between accepting and rejecting the proposition; when 
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TF Indices are — 34 to — 100 inehiaivc, they indicate a definitely 
negative reaction on tlio part of the group in aa mucli ns two-thirds or 
more of the group reject the proposition. 

Eesiilts 

Percentages of the 50 statements to which positive, mixed and nega- 
tive reactions arc made by each of the several groups arc given in Table 1, 


Tabic 1 

Percentages of the 56 Staleincnls to which Positive, Mixed and Negative Pcactions 
arc Made by Each of tho Several Groups 


Group 

Positive 

Mixed 

Negative 

All White Adults 

7% 

71% 

21% 

All White College Students 

34 

41 

26 

White College Males 

32 

43 

26 

White College Temalca 

30 

30 

30 

All Negro Adults 

45 

27 

29 

AU Negro College Students 

46 

34 

20 

Negro College Males 

41 

34 

25 

Negro College Feniftles 

48 

32 

20 


Prom Table 1 it appears that in the Avhitc adult group the percentage 
of mixed reactions is higher than either tliab of positive or that of negative 
reactions and even higher than the combined percentagea of positive and 
negative reactions. In the ^Yhifcc college groups the porcontage of mixed 
reactions is higher than either tliat of positive or that of negative reactions 
but not higher than the combined percentages of positive and negative 
reactions, On the other hand^ it appears that in all Negro groups per- 
centages of positive reactions arc higher than either that of mixed or that 
of negative reactions while combined percentages of positive and negative 
reaetions are in every case higher than the percentages of mixed reactions. 

The very strong tendency of the white adult group towards mixed 
reactions (two-thirds or more of the group being tied between accepting 
and rejecting the statements) may be thought due at lenat in part to the 
fact that the issuing of the questionnairea to this group was clone in 
person by a Negro wliich may have in a selective or moderating way 
influenced the reactions. On the other hand, the mixed reactions of this 
adult white group appear to be but a fuller manifestation of a tendency 
to reservation, i.e,, to inked reaction already perceptible in every white 
group of college students despite wViite ndiniiiisLration of the question- 
naires. Factors more likely influencing white groups to mixed reactions 
tnay be gleaned to some extent from scattered comments written in the 
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Table 2 

TF Inclicca of the Several White and Negro Groups for Each of the B6 Statements 



Adults 

College 

Students 

Male 

Collcgo 

Students 

Female 

College 

Students 

WJdto 

42 

240 

170 

70 

Negro 

151 

G60 

201 

399 

Total 

193 

906 

437 

460 

1, The practice of Negro lawyers should be confined to routine office work. 

White 

-55 

-51 

-53 

-47 

Negro 

-97 

-64 

-69 

-70 


2. In the eyes of the court one white witness is better than any number of Negro 
witnesses, 


W 

-12 

-17 

-21 

- 6 

N 

9 

31 

16 

41 


3. Negro lawyers aio as well prepared for the practice of law as are wliito lawyers. 


W 

45 

-10 

-18 

7 

N 

55 

48 

36 

61 


4. Where the litigation ia between a Negro and a whibc^ the white man or woman 


is favored to win in court without regard to the merits of the case. 


W 

-24 

37 

38 

34 

N 

34 

39 

20 

48 


B, Negro lawyers do not prepare their ensos as well os white lawyers. 


W 

N 

-16 

-53 

1 1 

-38 

-48 

-48 

-59 

6. Negro jurors are more easily swayed than white jurors. 


W 

16 

25 

31 

9 

N 

-20 

“17 

-20 

-15 


7- Negroes give too much irrelevant material in their answers to questions in court, 


W 

24 

30 

31 

23 

N 

1 

24 

23 

24 


S. Negroes should be represented on the staff of penal institutions in which the 


prison population contains Negroes. 


W 

N 

21 

89 

49 

77 

CD 

DO 

56 

75 

9, More severe sentences are meted out to Negroes than to whites for the same 

offense. 





W 

- 8 

46 

49 

34 

N 

64 

54 

51 

22 


10. A Negro represented by a white lawyer receives a, lighter sentence than a Negro 
represented by a Negro lawyer. 


W -43 

N 26 


24 

20 


28 

31 


13 

24 
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Table 2 — Continued 


Adulta 

College 

Students 

Male 

College 

Students 

Female 

College 

Students 

11. A light complexionccl Negr 

0 receives a moro Bovero judgment by a white jury 

than a dark comploxioiicd Negro. 




W -68 

-47 

-38 

-68 

N -44 

-64 

-63 

-54 

12. A Negro on a jury in the South is afraid to vote contrary to consenaus of opinion 

of the white jurors. 




W -21 

55 

65 

63 

N 52 

35 

28 

39 


13. A Negro litigant wlio ia employed in a menial capacity by inHaciitinl whites is 
tooTod to win in court over a Negro not bo employed. 

W -25 61 54 61 

N C9 67 73 63 

14. Judges have their mindB mado up betoro hearing a coeo when tho litigation is 
between a Negro nncl a whito. 

W -76 -G4 -64 -72 

N -21 - 3 - 0 - 1 

15. Negro lawyers /eel that Negro jurors are prejudiced in favor of the white side 
of the COSO, 

W -41 -66 -62 -73 

K -^24 -31 -34 ■ -29 

16. A Negro policeman, arresting a whito man cannot bring BufUeient evidence against 
him to Becuro his conviotion, 

W -60 -63 -62 -41 

N -40 -60 -02 -61 

17- Many coses of Negro conviction arc found to bo miacarriagea of juatice years 
afterwards. 

W -11 17 20 - 0 

N 48 CO 68 61 

18. Of several persons found flagrantly breaking the law, it is usually the Negro in 
the group who is arrested. 

W 0 40 33 63 

N 6G 64 45 01 

19. Other things being equal, a whito lawyer is favored to win in court over a Negro 
lawyer. 

W 7 71 76 60 

N 64 43 30 48 

20. A while woman's word in accusing a Negro is ‘’proof positive" in court. 

W 10 20 23 13 

N 46 66 61 67 
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Table 2 — Continued 


Mala Female 

Collego College College 

Adulta Students Students Students 

21. Without provocation Negroes are beaten and otherwise maltreated by white 
policemen- 

W 6 -26 - 9 -64 

N eo 63 62 64 

22. White policemen who, without provocation, beat up Negroes are never convicted 
of their olTcnsa. 


w 

N 

- 3 

06 

-ao 

30 

-10 

24 

-59 

34 

23. Negro lawyers will Jceep you in court the rest ol your life. 


\V 

-•25 

-82 

-82 

-83 

N 

-76 

-76 

-78 

-71 

24. White juries arc more prejudiced against the Negro on trial than white judges. 

W 

-21 

47 

60 

39 

N 

28 

24 

20 

26 

25. White lawyers make light of Negro lawyers in court. 


W 

-29 

20 

31 

14 

N 

- 1 

g 

20 

2 

26. White policemen do not cooperate with Negro policemen on the force. 

W 

-32 

-32 

-31 

-32 

N 

-61 

-27 

-34 

-20 

27. Judges are entirely free of racial prejudice, 



W 

-26 

-34 

-36 

-31 

N 

-72 

-51 

-61 

-47 

28. Negro lawyers lack the integrity of white lawyers. 


W 

-40 

-29 

-24 

-42 

N 

-93 

-59 

-69 

-60 

29. In the attitude of the court the Negro hns no rights which the white man is bound 

to respect. 





W 

-12 

-73 

-73 

-71 

N 

-38 

-20 

-60 

-22 

30. Even federal courts countenance refusal of certain privileges of the court build- 

ing to Negro lawyers. 




W 

14 

-12 

-17 

0 

N 

58 

21 

14 

27 

31. More white offenders are let off on insanity picas thon Negrooa when both are 

accused of the same offense. 




W 

38 

60 

72 

48 

N 

60 

72 

72 

71 

32. White lawyers have more outside influence with the court than do Negro lawyers. 

W 

49 

89 

91 

83 

N 

65 

82 

88 

78 
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T&blo 2 — Contmued 


Malo Female 

College College College 

Adults Students Studenta Students 


33. In the South n white person must bo quito a social outcast to bo convicted of a 
crime againafc a Negro. 

W 2G 38 40 35 

N 75 60 66 73 


34. The court bcliovea a white lawyer is entitled to a larger fee than a Negro lawyer 
for the same piece of work. 

W 18 8 8 7 

N 40 63 63 69 


36. If a Negro is numbered among n group of suspects, ho is usually the first to be 
grilled. 

W 41 60 62 64 

N 73 71 08 73 


30, Negro lawyers have ^a^Y opportunities to practice other than routine office work. 
W 10 43 30 63 

N 6 43 31 61 


37, Negroes do not deserve tlia privilege of a court trial like other people, 

W - 67 - 08 - 00 -100 

N -100 -100 -100 -100 


38. Negro lawyers do not tako extra courses in law after receiving their law degree 
because they have littlo opportunity to use their knowledge. 

W 3 -28 ’ -33 -17 

N -16 -22 -10 -24 


39. Negro offonders under legal ago are more often put into institutions with hard- 
ened criminala than white offeuders of the same ago. 

W 0 30 42 23 

N 06 57 68 57 


40. Many Negroes never bring suit against white persons, regardless of the amount 
of proof, because they feel that they are bound to lose in court. 

W 10 61 fil 61 

N 62 64 02 66 


41, In caaea of erroneous conviction of Negroes nothing is ever done to the porson 
or persons who originally brought the false accusation. 

W 0 10 12 2 

N 09 46 37 60 


42, In criTTiinal inBtitulions Negro offenders are segregated into poorer quarters, 
given the moat laborious basks, and are in other ways maltreated. 

W -10 14 15 14 

N 74 60 45 64 
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Table 2 — Continued 


Adults 

College 

Students 

Male 

College 

Students 

Femalo 

College 

Students 

43. la tho South the Bcntcncing of a Negro vagrant to a chain gang is ueually a life- 

sentence. 




W “3 

-66 

-68 

-67 

N 12 

13 

-10 

28 

44, Negroes receive as much justice in courts as do whites of similar social status. 

W -IB 

-11 

-10 

-13 

N -39 

-37 

-36 

-38 


46. A Negro lawyer in fche North receives fairer recognition in court than a Negro 


lawyer In the South. 


W 

N 

- 6 

78 

77 

85 

78 

88 

76 

83 

46. Negroes would not know that they were treated unjustly if it were not for agi- 

tative organizations. 




W 

-22 

-33 

-30 

-27 

N 

-47 

-49 

-49 

-43 

47. White policemen accept bribes from Negroes only to have them arrested for 

bribery. 





W 

-39 

-67 

-06 

-70 

N 

-42 

1 

-19 

16 

48. White policemen accept bribes from whites and do not have them arrested. 

W 

-41 

27 

36 

3 

N 

26 

40 

30 

46 

49. Negro lawyers are shy about going up against white lawyers. 


W 

-24 

24 

23 

28 

N 

-64 

-12 

-26 

- 2 

50, Negroes in reality convict themsclvea in court due to ignorance of legal pro- 

cedure. 





W 

2D 

7 

9 

2 

N 

14 

33 

36 

31 

61. In democratic countries where everything depends on majority-vote courts are 

necessarily unfair to members of minority groups. 



W 

-69 

-23 

-28 

-10 

N 

-40 

27 

29 

25 

62. All cases of whites vs. Negroes or vice versa i 

should be tried in Federal courts. 

W 

- 8 

-33 

-31 

-39 

N 

-13 

38 

42 

30 

53. A shabbily dressed,, “halrin-hand'' Negro lawyer has more influence with the 

court than a well groomed, intelligent Negro lawyer. 



W 

-64 

-47 

-42 

-50 

N 

-40 

-49 

-40 

-53 
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Table 2 — Continviccl 


Male Fcmalo 

College Coll ego Collcgo 

Adults Students SliidciiU SLudonls 


64. The victories Negroes win iti court arc left-handed victories. 

W -24 -34 -32 ^44 

N -22 -10 -10 -16 

55. Negroes are not aa financially able as whites to purchase justice in courts. 

W 33 65 08 66 

N 73 76 77 75 

66, It will tske many more years before the Negro can have his cOnatibutional riglita 
granted him by courts, 

W 28 41 43 38 

N 60 65 63 50 


margins of questionnaires by white students qs for examples: A white 
female student of the University of South Carolina with no court experi- 
encG writes: “Some of these injiislices against Negroes may be and 
probably are true, but they shouldn’t bc.“ A white male student from 
the same university writes: “Impossible to have an intelligent opinion 
on some of these questions, Negro lawyers aren't exactly numerous in 
the South." A white male student at the Univerfiity of North Carolina 
and with court experience writes; “Sectional factors and differences 
between Northern and Southern courts are of such a nature that I cannot 
answer adequately. Northern and Southern courts are ns different as 
night and day." A male white student of the University of Illinois says: 
“It is difficult to answer some of the questioiia unbiasedly because when 
they refer to the Soutli they may be true, and false when they refer to 
the North." A male white student from the same university: “Negroes 
deserve as much justice as whites, but it is undoubtedly true that they 
receive less. It will take many years, if ever, for tlicso social prejudices 
to be lived down," A white female student at the University of Florida 
writes: “I have no knowledge of the existence of a heal’ Negro lawyer.” 

A realisation of the complexity of the situation, an appreciation of 
more than one side to the matter, a conflict between ideals and practice, 
lack of familiarity wdth the problem, little or no emotional involvement 
in the matter appear to bo some of the factors making for mixed reactions 
so conspicuous in the whites. 

In Table 2 are presented the 56 statements and the TF Indices of the 
various Negro and white groups for each statement. From Table 2 it is 
possible to make a direct comparison of any two groups in their reaction 
to a specific statement. 
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In Table 3 are presented the Pearson correlation coefficients of the 
66 TF Indices for the various pairs of groups. 


Table 3 

Pearson Correlation Coeffioienta of the 60 TP Indices for fcha Yarioug Pairs of 
Groups Arranged in Descend ing Order 


Negro College Males and Negro College Pcmales .05 

White Collego Males and White College Females ,04 

All Negro College Studonts and All Negro Adults ,03 

Negro College Males and Whifco College Males .67 

Negro College Males and White College Females ,79 

All Negro College Students and All Whito College Students .78 
Negro College Females and White College Males .77 

Negro College Femabs and Whito College Females .76 

All White College Students and All Negro Adults .79 

All Negro College Students and All Whits Adults .72 

All Whito College Studonta and All White Adults .02 

All Negro Adults and All Whito Adults .60 


Conclusions 

The moat significant conclusions which may be drawn from the results 
of this study appear to be as follows: 

1. While Negro and white attitudes towards the 56 statements relative 
to the administration of justice aa affecting Negroes correlate to a signifi- 
cant degree, this resemblance is much higher between Negro and white 
college students (.78) than it is between Negro and white adults (.60). 

2. The correlation between attitudes is conspicuously higher between 
Negro college students and the Negro adults (.93) than between white 
college students and the white adults (.62), 

3. While the resemblance in attitudes between the white college 
students and the Negro college etudenta is high (.78), conspicuously 
higher is the resemblance between white college males and white college 
females (.94) and between Negro college males and Negro college females 
(.95). 

4. The attitudes of the Negro college females and of the white college 
females (.76) correlate less than do the attitudes of any other two inter- 
racial groups among college students. 

Rec&ived August 17 ^ 1944' 



Values Students Reported from the Study of Emotions 

Key L, Batliley 

Woman’s College of The Vnioersily of North Carolina 

Both the hiends and enemieB of psychology have criticised it as an 
undergraduate course in the university on the grounds that it contributes 
very little of real value to the student. The opinion hag been offered 
that perhaps the worst defect in the elementary course is that it is evasive 
in application, and that this weakness prevents the student from securing 
material whiclr actually functions in hia life. That is, the student may 
get a wealth of psychological fact, but receive little of psychological value. 

Purpose 

The purpose of the project reported here was not to discover simply 
what or how much the students knew about the facts, laws, and principles 
which characterize and govern human behavior, but to find out what 
values in any way or of any kind they believed they had secured through 
the study of a topic in psychology. The word “value" was interpreted 
to the students to mean any benefit, help, or gain they had received from 
the study, or any detriment, hurt, or loss they had suffered. In order 
to make the findings as definite as possible, to give the students a restricted 
topic on which to formulate judgments, and to increase the probable 
accuracy and dependability of the findings, the study was limited to the 
topic of “emotions.’’ 

Subjects 

Two hundred twenty-six students of elementary psychology, who 
recently had completed their study of the topic of emotions, contributed 
their statements of values received. All of these subjects had tlic same 
readings assigned from two basic texts, and all of them had about the 
same number of Iccture-discnssion periods, namely six. 

Procedure 

Since there was no instrument available for the students to use in 
stating their judgments of values received from the study of emotions, 
the investigator had to devise one. To that end, forty-eight students 
were asked to write essays of about 200 words on the topic “The Values 
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I Have Received from the Study of Emotional' The experimenter read 
the essays and made a list of all the values the students said they had 
received. Erom the collection of statements, which were kept in the 
students' own words as far as possible, a check-list was made with the 
various stated values classified under nine arbitrary headings. The 
changes in statements when made were simply to shorten or to generalize 
the item. 

The completed checklist was given to the students with the directions 
to check all the items which were statements of values they had received 
from the study of emotions, and to write in statements of values received 
which were not given in the list. It was made plain to all the students 
that their work with the check-list would have no relationship to then- 
standing in the course in psychology which they were studying at the 
time. 


Results 

The number of people who checked the various items on the check- 
list was tabulated, and the per cent of the total of 226 subjects who 
checked each item was calculated. These percentages are shown in 
the first column of Table 1, which also presents the items in the check-list 
used in the experiment. 

Certain findings are reasonably clear from an analysis of the data. 
The most obvious one is that over 80% oi the students say they received 
definite and known benefits from the study of emotions. Only 17.3% 
of the students said that the study of emotions had had very little effect 
on them as persons (see item number 73). Moreover, some of those who 
made this statement went on to explain that they had received some 
advantage from the study, because it would help them in their professions 
such as social work. 

A second clear finding is that a large number of people said they had 
received the values given in the check-list. The average number of 
persons out of the 226 who checked each item indicating a favorable 
value received was 128, or 66.6% of the group. It is obvious also that 
each person must have checked a considerable number of items. The 
average number of items checked by each person out of the total of sixty- 
four possible ones was 35,8. This means that most of the students believed 
they had received a large number of definite values from the study of 
emotions. It is probable, however, that no student received a separate 
and distinct value for each item checked, since there is considerable over- 
lapping between some items. 

The check-list was fairly comprehensive, and adequate to give the 
students an opportunity to indicate all the values they believed they had 
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Showiing cbcck-list on which to indicate values received from the study of emotions, 
and tho per cent of the 226 Bubjecta who checked cncl\ item. 

DiTcctioLB^ Put n check in the blank space before each statement of n vnluo yon hEL\o 
received from the study of emotiDna. If -you have received a value for which Ibcrc is 
Eo statement, write out a statement of the valuo in the place provided by n blank 
number under each heading. 

L General Values 


1. It hoa given me a better conception of emotiane; learned what emotions 
aro and whnt they involve; gained insight into ray own emotional life. 

2- Learned when emotioos occur, that omotionc aro the natural result of 
strong stimulation. 

3. Learned to look ot my own emotional problems objectively. 

4, Learned that etnotions aro governed through the autonomic nervous 
system. 

6. Study of emotions has been interesting and infortnativc. 

6. Learned about a factor that has greatly inducnccd student life. 

7, Discovered that psychology has some practical values right now. 

8. Improved my own general happiness through improved adjustment. 

9, Established a firm background on which to base fcclingB and atlitudcs. 

10 .* 

II, Development of Emotionfl 

86.7 11. Learned that the aim in emotional development should bo bo direct and 

control rather than to inhibit erne bi one. 

31,4 12, Learned that there ifl a native ''core'* of emotional behavior. 

82.3 13. Learned that emotioiiB arc behavior, hence subject to change and develop- 

ment, especially through learning. 

77.4 14. Learned that other pcoplo have a great influence upon our emotional 

development. 

40.3 16, Discovered some good ways/meane of emotional devclopment. 

83.6 16, Learned that emotions can bo recognized, understood, and then corrected, 

or directed and controlled. 

63. 1 17. Learned what sliould bo emphasized in the emotional education of children. 

61.3 18. Learned that emotional re-education is possible; learned about emotional 

re-education, including the methods for removing undesirable emotional 
traits, 

46.0 10. It has taught me which traits to avoid and which ones to attempt to 

attain. 

36.4 20, Learned how emotionfl are differentiated, 

64,9 21. Learned how emotions are cstabliabcd and developed. 

46.1 22. Set up new goals; am now striving to emulate the standard of emotional 

stability set up in the course; I will try to meet the next Bct-back with firm 
rcBolution and not give way to emotion. 


Per Ccat 
Who 
Checked 
Item 

74.4 

78.8 

62.8 
62.2 

74.3 

46.6 

71.7 
29.2 
42.0 


23 .* 
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Per Cent 
Who 
Checked 
Item 


74.3 

63.1 

60.8 

83.0 


70.1 


70.8 

04.0 

54.0 

27.4 
59.2 

06.4 

77.4 


66.9 

60.0 

50,4 

38.6 

78.3 


62.8 


30.5 

60.0 

36.4 


III- Role of Emotions in General Adjaatmcnfc 

24, a, Emobiona as Motives, Learned that omotiona serve as motives. 

26, h. Emotions oa Motives, This study motivated me to bettor efforts 

toward more wholesome emotional living- 

23. Learned that emotions serve as f Belli tatora and inliibitora of behavior in 
general, 

27. Learned that a successful life miiat be founded on a firm emotional basis; 
a auccebslul life is greatly dependent upon emolioDnl stability and emo^ 
tional maturity. 

2B. Helped mo to see the important role they play in our lives. 

29. * 

IV. Values Connected with the Experimental Study of Emotions 

30. Learned that emotiona cannot be judged from facial expresBiona. 

31. Learned that the study of emotions is incomplete. 

32. Awakened a new interest in the further study of emotions. 

33. Learned how to measure emotiona. 

34. Discovered the difficulty of measuring emotiona experimentally. 

35. Made me more aware of emotions, viz., just what occurs in emotional 
actioD. 

30. Learned how closely related arc fear^ joy^ and rage in the effect on tbs 
body. 

37. * 

V. Influence of the Study of Emotiona upon Helationahips with Others 

38. Made Btudent more tolerant of other people's conditions. I am now not 
as apt to criticize friends of mine. 

39. Improved my adjustment to other people, 

40. Developed better insight into the emotional life of other people; I am 
better able to help them. 

41. Enabled me to aid another person to overcome an emotional depression. 

42. I am able to look nt others' reactions more objectively. 

43. * 

VI. Values Connected with Emotional Maturity 

44. Learned what constitutes emotional maturity, hcncc can work toward it 
now, I know what is expected of me ns a college student. I realize the 
attributes possessed by the emotionally mature person. 

45. It helped me to tic together all the loose ends in order to make more con- 
crete my philosophy of life. 

40. Aided student to recognijse her limitationa and powers. I have disco v- 
ored where I fall short in being emotionally mature. 

47. Discovered pause of poor adjustment to be emotional immaturity and 
mstiibility, and learned what to do about them. 
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Per Cent 
Wlio 
Checked 
Item 

72.1 48. Learned some oI the causes ol emotional Immaturity. 

18.6 49. Helped me to emancipate mysoH from my homo. 

79.6 50. 1 have aeon the importance of being emotionally mature and etablo. 

63.5 61. Learned some of tlie necesaary ways of Bolving children's problomfl. 

Learned how to help fchom become emotionally mature. 

62.* 

VII. Values Connected with Emotional Stability 

56.2 53. Learned what constitutes einotioiia.1 stability, and how to wort toward it. 

It ia very helpful to Imow what makes a person emotionally stable and 
how to acquire these things. 

40.7 64. Learned means of emotional con trol/rcs train t. 

73.0 56. Learned that if a person will do something about a troublesome situation 

ho will worry less. 

32.7 66. I have gained fuller mastery of myself; attained greater emotional sta- 

bility. 

31.4 67. Learned how to overcome unfortunate moods. 

81.9 68- Learned how important it is to your health and well-being bo be emotion- 

ally stable. 

69.* 

VIII, Special Individual Benefits 

13,B 60. Helped mo through an emotional crisis. 

26.2 bl. Aided efbcieiicy in study and work. 

79.2 62. Learned that my emotional problems are not unique, but probably many 

others have them* 

70.8 63. Learned that intense emotion may be harmful. 

2B.8 64. Lost queer notions, fear and apprehension regarding emotions. 

23.9 65. Helped me to quit emotionally colored thinking. 

64.2 • 66. Learned that most fears are unnecessary and handicapping. 

40.3 87. Evolved the practice of being honest with myeelf os well as with others. 

64.6 68. Study of emotions made me think and wonder about myself. 

33.2 69. The study of emotions has made me more hopeful. 

67.3 70. Learned that the facial expressions of o thera are nob a safe guide to conduc t. 

50.0 71- Learned some steps to take in solving emotional problems and will be 

better prepared to meet emergency situations. 

72.* 

IX. Negative or Questionablo Valuca 

17.3 73. 'Kje study of emotions has had very little effect on mo as a person* 

74.*- 

* Items numbered 10, 23, 29, 37, 43, 62, 69, 72, and 74 provided an opportunity to 
write in atatements of values received not given in the questionnaire. 
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received from the study of emotions. Only four new items were listed 
by write-ins in the spaces provided for such additions. The remainder 
of the total of thirteen write-ins were criticisms of the course iu psy- 
chology, or restatements of items already in the check-list. 

All students did not secure significant values from the study of emo- 
tions. Seventeen per cent indicated that they had been helped very little 
by the study. 


Some Conclusions and Criticisms 

1 . The method used in this study is in many ways subjective in nature, 
hence liable to errors which could not be checked on either as to their 
presence or degree. For example, many of the stated values which the 
students say they have received may be simply verbalimtions not ac- 
companied by real changes in the personalities and adjustments of the 
students. This weakness is indicated by the fact that some subjects 
checked a number of items as values received, but checked also the 
statement to the effect that the study of emotions had had very little 
effect on them as persona. But the fact still remains that move than 80% 
of the group indicated without reservation that they had received many 
positive values from the study of emotions. 

2. The findings presented here represent the reactions of students 
in one university only where the first course in psychology is taught with 
a certain emphasis. In other universities where the first course is 
taught with a diHerent emphasi5, the responses of students might differ 
greatly from these. 

3. This survey is a preliminary one, as it obviously must be, since the 
number of subjects is small The emphasis upon the general benefits 
received from a course of study, rather than simply upon the knowledge 
of facts secured from it, is healthy, and the technique employed here 
appears to be a useful one. In this connection it should be pointed out 
that the values listed by the students were about equally divided between 
those which were strictly a matter of acquired knowledge and those which 
were of the nature of some new skill, changed viewpoint, better method 
of adjustment, etc. But the average per cent of the group who checked 
the knowledge values was 05, whereas the average per cent checking the 
other values was 48%. 

4. Even though 80% of tlie students said they received many values 
from the study of emotions in elementary psychology, something should 
be done to reduce the percentage of students who say they get little or 
no benefit from it. In this University over three-fourths of the students 
who take the first course in psychology in normal times do not go on to 
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higher courses. The first course is often psychology's Inst chance to 
bring benefits into the Uvea of students through classroom instruction. 

Received September 18, 18U. 
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Aircraft Recognition; I. The Relative Efficiency of 
Teaching Procedures * 

loster Luborsky 

Duke Univeraity 

Thus far the teaching of aircraft recognition has not been subjected 
to any reported experimentally-controlled analpis of learning product 
or comparison of teaching techniques.' The present Navy recognition 
program is baaed largely upon the groundwork of general principles arising 
from tho research of Renahaw of Ohio State and his students, Sohwarzbek 
(8), Knight (3), and others (1, 2, 6, 10).' Their experiments led to such 
current emphases in recognition training as high speed presentation and 
perceptual learning of wholes rather than verbal learning of parts. 
Verbal learning of parts is emphamzed in the WEFT system in which the 
characteristics of 4 main parts, the wings, engine, fuselage, and tail 
are memorized. 

The standard instructional procedure — which has proved highly 
successful— used in most Navy recognition schools is somewhat as follows : 
When new planes are first introduced the shutter is set on “time" ex- 
posure — ^i.e., the shutter remains open end the airplane on the projection 
screen is visible until the plunger is pressed again — while good recognition 
features are pointed out by the instructor. Then, in the regular practice 
sessions which follow, the views are exposed for a short period, from 1" 
to 1/50", depending upon the particular school, and identification is made 
by the student. After each such identification, except during tests, the 
same view is reexposed for 3"-10" and reidentified and discussed. It is 
thought beat to use a large number of different views of each plane. 
The number of different views varies from 5 to 6, to a new view each 
time the plane is shown. The most usual rate of introducing new planes 
is 2 planes per session.^ 

• Part of a thesis submitted in partial fulfillment of the requirements for the degree 
of Doctor of Philosophy in the Graduate School of A.rta and Bcienccs of Duke Univer- 
eity, 1046. Grateful acknowledgment ia mado of the aasistanee of two menbera of the 
Department of Psychology, Duke University: Dr. ICarl Zener for sponsorahip of tho 
project, and to Dr. Sigmund Koch for valuable advice. 

* Since coinpletion of this experiment a summary of the research by Staff, Psycho- 
logical Test Film Unit (9) has reported work on aspects of training procedures related to 
those dealt with in tho present report. 

’ For valuable discussion of current training techniques and for access to clanses the 
author is indebted to Lt. Comdr. H. L. Hamilton, Lt. W. C, Schwarabek, and Lt, 
Comdr. R. H. Bruce of the U. S. Navy Pre-Flight School, Chapel Hill, North Carolina. 

385 



386 


heder Liihorsky 


Uenshav; and later workers developed the pvGvSent program em- 
pirically on the basis of their past research findings. As a consequence, 
many differences in practice resulted, such us the variation in use of 
training exposures from 1/50" at some schools to 1" at others. Vari- 
ability also occurs in tlie number of views presented and in the rate of 
teaching new planes. 

It tlms sceined desirable to test the relative effectiveness of several 
present differences in practice, and, in general, to snbiect a number of 
major variables of the training teehnique to experimental analysis* In 
brief, tlie object of the experiment was to determine, ns exhaustively ns 
possible, tlie effect of 4 basic variations of aircraft identification instruc- 
tional procedure on tho total learning behavior of equated classes of 
subjects. Tlie design of the experiment was essentially: 

1. The ad minis bration of a battery of tests onlculnted (a) to measure 
possible perceptual and learning factors associated with "aircraft identifi- 
cation ability" and (6) to aid in equating the groups for possible factors 
affecting trainability, 

2. The actual training of 4 equated groups under different instruc- 
tional conditions. 

3. The administration of an extensive battery of post-training tests 
in order to facilitate more complete analysis of the learning product for 
the 4 groups, 

The resulting data offer the opportunity for analysis of many of the 
determinants of aircraft recognition ability. The present report will be 
restricted to the major question of the relative efficiency of performance 
as ft function of 4 training techniques. A future article will take up the 
role of other factors, including the span of apprehension, various measures 
of visual memory, and a fuller treatment of reaction time, 

Procedure 

Four equated gioups, 8 Navy students in each (6 in Group I), were 
taught aircraft recognition in a standardized manner for 46 miautes on 
Monday, Wednesday, and Friday for a 6 week period in May-June 1944. 
For 3 of these groups one different experimental condition was varied. 

The experimental groups were designed to compare the effects of two 
kinds of short exposure,^ 1/50" vs. 1", both used in conjunction with 
approximately the same number of long exposures of tho same stimuli 
(Grov^p I vs. Group III) the presentation of a large vs. a limited number 

^For the purposes of Bimplioiby, exposure timo will bo called 1/50" and 1", althoiigli 
tho calibration values give sliEhtly different results (aco Apparatus, p> 389), 

^ The total number of 1/50'' cxposurca given to Group I was approximately 195 up 
to and including Test 9. An approximately equal number of exposures between 1/10" 
and 1/60" were given in tests before the 1/50" speed v?aa attained. 
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of views (Group I vs. Group II); and the slow introduction of new planes 
vs. a rapid introduction, followed hy review of confused planes (Group 
I vs. Group IV). In other respects an attempt was made to make the 
procedures comparable to those most frequently used in Navy recognition 
schools. For all groups in which tests were given at 1/50''" during train- 
ing, the speed was attained by progressively reducing the exposure time 
during testa from one session to the next— starting at V' at the beginning 
of the second week and reaching 1/50^^ by the last session of the third 
week. At each session three new planes were taught until^ by the middle 
of the fourth week, 33 planes had been presented. By the end of the 
training period approximately 8 different views of each plane were used. 

In Group II the exposure time and other variables were similar to 
Group I except that the number of views of each plane was limited to 
3 diagram views. Group III was given V' exposures and Group I, 
1/50" exposures during tests. As will be indicated below in the descrip- 
tion of training procedure, exposures for review and teaching were longer. 

In Group IV an answer was sought to the question of the effect of 
teaching new stimulus material at almost twice the usual rate and then, 
after completing the syllabus, giving special instruction on the most 
frequently confused stimuli. As part of this special instruction, the moat 
frequently confused j^lanes were shown simultaneously on tlie screen and 
difforcntlation features stressed. When a large group of difficult homo- 
geneous views were reviewed in this manner, as e.g., Iicad-on-viewa of 
single engme Qghter planeSj the students sketched these irbiJe learniDg. 

Training Procedure, Training, as described in the paragraph below, 
is composed of all the procedurca which Avere directed toward the sub- 
jects^ learning of the present aircraft recognition task. Training includes 
the frequent aircraft recognition tests and the review which followed 
these tests during which each plane was reexposed Training also in- 
cludes the teaching of new planes and the review following this teaching, 
and the home study done by each subject. The paragraph below de- 
scribes the training aspects of a typical session. In addition to this, 
training continues outside of class in home study. All groups were 
given tlic same general training procedures, with the exception of the 
experimental training variables mentioned above (exposure time on 
tests, number of views of each plane, and the rate of introducing new 
planes). 

During the first 3 minutes required for dark adaptation, announce- 
ment a were made of scores in the last test, etc. Then a test was given of 
planes taught up to that session in which subjects recorded the name of 
each plane on a specially lined mimeographed sheet. This required 10 
to 18 minutes, depending upon the number of planes, which increased in 
successive tests as training was continued. The rate of presentation 
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was 4 per minute. The experimenter, by watching the face of a largo 
Bweep-second hand clock, maintained a rather constant presentation 
tempo. All planes in this test were then reviewed for instructional 
purposes on time exposure. The time exposures were approximately 
3'^ to 6", The subjects called out the name of each plane and were 
corrected when necessary. Subjects* questions were answered at this 
time to avoid making the review too mechanical. In the last 4 training 
sessions and in the 'Uraining-ir* ^ sessions, the exposure time during 
this review was changed from about to one or more 1/10" exposures 
in order to give more practice with short exposures. For Group III the 
review exposure time was changed to 1" at this time. The number of 
presentations in this review was detennined by the number needed to 
equalize the total number of presentations for each group for the entire 
course, e.g,, Group IV wag given fewer since more planes were covered 
in each session. Approximately 3 minutes were then devoted to the 
teaching of each new plane. The head-on, plan, and side diagrams were 
viewed in succeaalon, and good reeognition features were einphaflizcd by 
the instructor. After each view, remiudera were given to attempt a vis- 
ualization of the plane from all angles, to avoid irrelevant cues, and to 
make outline sketches while learning the plane. In the early part of the 
course, some suggestions for efficient study had been given and these were 
frequently reiterated. In addition, an interest item was mentioned for 
each plane, suoli aa its uae, or an example of its outstanding performance. 
The new planes were then reviewed on time exposure while the class 
called out the code number and name. Exposures were then speeded 
up to about 1/5" in the latter part of this review. For Group III, how- 
ever, no exposures less than 1" were given. 

Following the 4 week training period, for Avhich the instructional 
procedures have been described above, was a 2 week test and "troining- 
II" period, During these 2 weeks training was continued except that 
now all classes were given identical teats and trained to the conditions 
of Control Group I, i.e., all groups were given 1/50" training, and picture 
as well as diagram views were included. In this 2 week period, 3 main 
traioing-II tests were given: Test 10, Test 11, and the Final Test. These 
testa will be described later in the section called "Testa of Recognition 
Performance during Training." Other tests were also given in other 
sessions of the training-II period, which will be referred to as "post- 
testa" in contradistinction to the "pre-teats." These post-tests were 
either repetitions of the pre-testa or teats of other aspects of the learning 
product, 

To achieve uniformity in the use of study materials, all students were 

* See paragrfrph following. 
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supplied with two standard aircraft recognition books (6, 7) and required 
to avoid any other material. A questionnaire on study methods filled 
in by the students near the termination of the training period shows that 
in general these books were the only material used. 

Apparatus 

The 8 subjects in each group were seated about 5 feet from a projec- 
tion screen. A constant seating position was maintained for each sub- 
ject. The arrangement of seats was such that 4 subjects sat slightly 
out of the center line. This probably did not influence the pre- and 
post-tests or the rate of learning, since an analysis by seating position 
shows no differences related to seating. The experimenter operated a 
Baloptican, with an attachmont supporting an iris-diaphragm shutter. 
This apparatus was placed immediately behind the students, Stimulus 
cards were fitted into a specially constructed postcard holder ® which 
permitted ready changing of cards — in as short a time as 4 seconds. 
When the ready signal was given, the subjects fixated the center of the 
screen, and immediately after, the exposure was released by pressing the 
shutter-plunger, 

Photographic calibration of the shutter was performed twice before 
and once after the experiment. The shutter speeds called 1/50^'' and 1'' 
in this experiment gave calibration values of 1/40'^'' and 4/5^'" respectively. 
Percentage changes from before to after the experiment were less than 6%, 

Two sets of screen illumination readings were taken with a Macbeth 
Illuminometer. One set was taken with the room in semi-darkened 
condition and the other with the shutter opened on time exposure (with 
a blank card in the Baloptican). In the semi-darkened condition the 
screen reflected evenly 0.28 foot candles from a 15 Watt gooseneck lamp 
in the center of the room. The subjects recorded their responses to tests 
in this low light. The screen reflected evenly 2.55 foot candles of light 
when the shutter was open on time exposure. This was the illumination 
reflected from the screen when a plane was shown. 

Twenty-five American and 11 British planes were selected for the 
syllabus because of their frequent use in combat. 

Comparison of Group Scores 

What is the effect of each of the experimental variables on the learning 
of each group? The complete data for training-I and trai23ing-n testa 

® Tliia postcard holder wag constructed with a thin slot through which the stimuluB 
card could be slipped in place for projection without the necessity of removing the post- 
card bolder from its position beneath the Baloptican to cliangc stimulus cards. 
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are given in Figure 1. The actual per cent correct scores for 5 of these 
tests which are especially important are given in Tabic lA. The first 
of these^ Average of Tests 1 and 2, may indicate the amount of the 
differences existing between groups before training. Test 9 indicates 
the effect of the exi)crimcntal variablea when tested under the conditions 
of these experimental variables. Teat 10 is the moat important teat of all 
since it is given to all groui^a under identical conditions immediately after 

i 



'Fig. 1. Per cent correct scores on 9 training-I teats and '3 training-II teats. (Seo 
text.) The i upper score curves for training-II teats were given at 1" exijosure and 
the lower at 1/50. 


completion of training^ and reveals most clearly the differential effects 
produced by the different training procedures. Test 11 and the Final 
Test are important in showing the consistency of the differences, but 
measure only residual effects of Die training procedures. In the more 
detailed presentation to follow, the scores on Teat 10 ato italicized to 
emphasize their importance. 

1. Limiialion in Numbei' oj Views: Group I vs. Group II. A com- 
parison of scores for Group I (the 1/50" exposure group) and Group II 
(the limited-view group) indicates a small but consistent inferiority in 
Group II. Scores (per cents correct) on Average of Tests 1 and 2 and 
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Table lA 

Per Cent Correcb Scores on Two Training-I and Three Training-ll Teste 

. Training-I Tests TraininE-II TeaLs 

Avi of Testa 

land 2 Test 9 Test 10 Testll Finnl Test 

Expoauro 

Time 1^' 1/60" 1/50^' 1" 1/50" 1" 1/50" 1 

Group 


I 

.76 

.61 

.65 

.71 

.60 

.73 

.60 

.80 

ir 

.76 

.05 

.46 

*67 

.58 

.67 

.53 

.68 

III 

.81 

.82* 

M 

,87 

.64 

.85 

.61 

.83 

IV 

.80 

.62 

.06** 

,83 

.67 

.80 

.62 

.80 


* Group III was given 1" exposure. 

Two wceka had elapsed between completion of ayllabus and this test because of 
the accelerated Bchedulo for introducing new planca. 

t** This test may be someiyhat less reliable than the others since scores aro based on 
^ teat of only ten planca. 

Table IB Table 1C 

Per Cent Correct of Picture and Diagram Views Recognition Time for Planca 
for each 1/50" Training-II Test (recorded on the planes in 

Teat 10 in l/60^^unifcs) 


Test 10 Testll Final Tost Recog. Time 

Group Pic. Diag. Pic. Ding. Pic. Diag. Group 


r 

,60 

.60 

.65 

.64 

.48 

.62 

I 

69.7 

II 

.28 

.63 

.62 

.63 

.48 

.68 

II 

66.9 

III 

.62 

.67 

.65 

.02 

.58 

,64 

III 

54,3 

IV 

.58 

.74 

.66 

.68 

.61 

.63 

IV 

61.1 


the three 1/50'''’ training-II tests are respectively as follows: Group I, 
75, 60, and 50%. Group II, 75, 45, 50 and 53%, The reliability 

coefficients of the differences between groups as indicated by t ratios are 
all greater than the 5% level of significance. (See Table 2.) For the 
1'' training-II test^, however, scores for Group I are somewhat better 
than for Group 11. The reliability coefficients of the differences are 
again above the 6% level, but all favor Group I. 

Analysis of the percentages of picture vs. diagram views recognized 
correctly on Test 10, Test 11, and Final Tests (see Table IB) reveals the 
source of Group II's low scores as due to poorer performance on picture 
as compared with diagram views. In Test 10, scores for diagram views 
are almost the same whereas for picture views the scores are 50% vs. 
28% for Groups I and II respectively* Of course, the particular picture 
views used were completely new to both groups, the past difference in 
training being that Group I (and other groups) had had practice with 
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other views and Group II had had only the three stereotyped diagram 
views, 

2. Fjxposure Time: Grouj) I vs. Gvouf IIL Group III (the V' 
exposure group) appears to be somewhat superior to Group I, On 
Average of Tests 1 and 2 and the three 1/50^' trnining-II tests^ scores 
for Groups I and III arc 75> 65, GO and 60% and 81, 50, 64, and 61% 
respectively. The corresponding t ratios are statistically unrcliablQ 
but all favor Group III. 

Another aspect of the relative efficiency of performance of Groups I 
and III can be measured in terms of recognition time. Tliis compnriaon 
should be important because proponents of the use of 1/50^' exposures in 
training may maintain that there arc other advantages which do not 
emerge from comparisons of per cent correct scores, especially the im- 
portant advantage of more rapid recognition. In Tost 10, given immedi- 
ately after completion of training, subjects were required to indicate 
recognition by lifting their forefinger from a reaponse key in circuit with 
a standard timer. The name of the plane, given verbally by the subject, 
was recorded by an assistant. The results in Table IC show conclusively 
that an advantage for Group I in recognition speed did not exist. Fur- 
thermore, accuiacy and speed of recognition in Test 10 for all subjects 
proved to be uncorrelated (r = ^ .16), 

3. Rate of Introduciion of New Planes, ‘ Group I vs. Group IV, Group 
IV (the rapid-pi'csentation-plus-rcvicw group) is superior to Group I. 
Scores on Average of Testa 1 and 2 and the three 1/50" training-II tests 
were 8Q, 66, 67, and 62%, as against corresponding values of 75, 55, 60, 
and 50% for Group I. The / ratios for tlic differences between Groups 
I and lY on training-II tests are 1.83, 1,31, and 2.29. Although only 
the last of these is significant at the 5% level, the direction of all of them 
favors Group IV. 

A second, and obviously related aspect of the results concerns the 
intcrcomparison of all groups. Groups III and IV give the best results 
of all 4 groups. After completion of the 4 weeks training period, it was 
found that Group III did ns well as both Groups I and II at 1/50" 
exposures (Test 10) even though no previous iTaining on planes at 1/50" 
had been given. Furthermore, Group III did somewhat better on this 
test than any other group with 1" exposures. Group IV seems to be 
slightly better on the Final Teat at both 1/50" and 1" than any other 
group. The t ratios for the differences between Groups II and III on 
the three 1/50" training-II testa are 1.41, 0.83, and 1,25, and for the 
Groups II and IV they are 2.49, i.59, and 1.95. 

Final evaluation of the differences in this section depends upon the 
reliability of the differences and the comparability of groups which are 
discussed belo\y. 



393 


Aircraft Recognition: I 

Reliability of Differences 

How Jniich conficlenoe can be placed in the obtained differences? 
Since the number of aubjecta in each group is small and the absolute 
values of many of the differences not particularly great careful consider- 
ation must be given this question. 

Table 2 


Reliability of Difforcncea Between all Groups on Averago of Tests 1 and 2 and 
Training-H Testa {t ratios) * 


Group 

Av. Tcaba 
land 2 

Teat 10 

1/50" 1" 

Test 11 

1/80" 1" 

Final Test 
1/50" 1" 

I 

II 

0.00 

1.20 

0.33 

0.23 

0.80 

0.46 

1.23 

I 

III 

0.87 

0,51 

l.dO 

0.66 

1.90 

1.62 

0,31 

I 

IV 

0.73 

1.83 

I.IO 

1.31 

2.14 

2.29 

0.82 

IX 

III 

1.01 

1.41 

3.04 

0.83 

2.49 

1,25 

1.60 

II 

IV 

0.7G 

2.49 

2.96 

1.67 

2.66 

1.9B 

2,12 

III 

IV 

0.14 

0.80 

0.03 

0.82 

0.28 

0.20 

0.63 


* If underlined the difference is within the 5% level of signilicance, i.e,, greater than 
2.17 for those differences involving Group I and greater than 2.14 for others. 


Table 2 presents the t ratios for the differences emerging from inter- 
comparison of tho performance of all groups on the Average of Tests 
1 and 2 and the 3 crucial training-H teats for 1/50'' and 1" expoaurea. 

Although these reliability measures for the most part are not sta- 
tistically significant, examination of Figure 1 will reveal that the results 
show a consistent direction. It is this consistency of direction which 
suggests that the main differences, i.e., those between the first 2 and the 
second 2 groups, may be real ones. 

Comparability of Groups 

More important than statistical reliability in the case of such small 
groups is the question of the rigor of equation of all variables other than 
the experimental ones, The groups were relatively satisfactorily equated 
before training for 2 factors with evident importance for trainability 
intelligence and previous knowledge of planes. The results of this 
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Scores for Each Group on Equation Tests 
And Other Tests Which Could Have Ageeted the TrainabUity of the Groups 
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equation will bo prosDnted in Table 3 together with the results of tests 
of the otlier factors which might have been responsible for differencea in 
the tminabiiity of the groups. In tiic following list of these factors^ 
tlie nfimo of the measure alone gives some suggestion as to the nature of 
tlic measure. A complete description of each will be given in another 
report (4), The list is: 1, Intelligence (A, C, E.); 2. Previous Knowledge 
oi 3. Gj*axJe,9 in Aciulomc Wo2‘k fo2‘ p2’ovi^?w5 Bomc^ier; 4. 

Study Time for Aircraft Itecognition; 5. Acuity (Snellen Symbol E 
Chart); 6. Interest I; 7, Interest II (Iinjiroveraent) ; 8. Reaction Time 
(Lig)it Flash; Common Objects; Airplanes); 9. Span of Apprehension^ 
1/50^'; 10. Mcmory^Location, 1/50'^; IL Memory-Complex Figures, 
Part 1 1/50^^; 12. Memory-Complex Figures^ Part 2 1/50^^; 13. Memory^ 
Complex Figures, 5""; and 14. Memory-Aircraft Recognition Aspects, 
l/S0^^ 

Although the differences between groups on the above tests (see 
Table 2) appear small enough to disregard if taken singly, Group I and 
to a lesser extent Group II, are lower on several tests (Memory-Complex 
Figures 6^^ and Memory-Complex Figures^ Part I, V5O'0 which have 
been found (4) to be important in determining final level of performance. 
Since the effect of these differences is not determinable, the differences 
between groups in aircraft recognition tests must be somewhat larger 
to be meaningful than they otherwise would have to be. This will 
primarily affect the conclusions based upon Group I va. Gj’oup III. 

Other differencea not covered by the above measures may have 
existed. For example, the differences in group scores obtained on 
Average of Tests 1 and 2, ranging from 0% to 6%, possibly were not 
produced by the experimental variables in training procedure, although 
these variables may have slightly affected the scores of Group IV and 
Group II. This may be a crucial criticism. However, a reanalysis of 
the data on the basis of a re-equation of groups shows that it does not 
materially affect the results. Tho re-equation was carried out in the 
following manner: Average of Tests 1 and 2 scores of 4 subjects, one from 
each group, were selected on the basis of how nearly they were alike. It 
was possible to find one low, high, low-middle, and high-middle score 
which was almost the same in each group. The means of these 4 sets 
of scores/ one for cacln did not differ more than 0,5%, These re- 

equated groiip'means on Average of Tests 1 and 2 were then compared 
with the mean of the same 4 subjects on Test 10, Test 11, and the Final 
Test. Virtually the same relative differences among the scores were 
obtained as with the original data. The re-equated Group IV, however, 
was slightly higher on the Final Test. 
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Diacufision 

A number of auggestiona for optimum training procedure may bo 
immediately inferred from our results: 

1. Group II procedure seema to be the least efficient, Therefore 
teaching materials which are restricted to only 3 diagram views of each 
plane, as are those of many spotters^ courses, are disadvantageous for 
proper learning, and cause difficulty in recognizing other, more lifedike 
views 

2. A training procedure including tests at exposures varying from 

to 1/50'^ has no evident advantages over a procedure having no 

exposures shorter than 1^' (Group I vs. Group III). The slight apparent 
superiority of Group III on aircraft recognition tests is difficult to evaluate 
because of the small initial Buperiovity of this group on Average of Teats 
1 and 2 and on some of the pre-tests which are correlated highly with 
final level of performance. There are three possible interpretations to 
the failure of Group I to show any superiority over Group III on Test 10 
which constituted the first experience of this group with 1/50'^ exposures. 
There may, in fact, actually be no special skill for seeing under short 
exposure conditions. The development of such a skill may not readily 
occur in the absence of conditions permitting operation of the law of 
effect, that is, more immediate identification of the plane verbally or by 
re-expoaurc for a longer time. Or lastly, a longer period of training with 
1/50" exposures^ as is usually found in recognition programs, may bo 
necessary. 

The data presented in the next article (4) would enable a more com- 
plete equation of groups than was possible before this experiment and 
would open the way to a definite answer to the problem. 

Since the speeds tested in the present experiment are within the range 
considered short exposure, they offer no direct implicationa as to the 
relative advantages of short vs. long exposures. (Long exposures are 
here considered as 3 to 10 seconds.) Possibly some combination of long 
and short exposures may be more efficient than predominant use of either. 
This technique is employed in some recognition schools. In addition, 
more consistent and definitive use was made of the 1" and 1/50" exposures 
than is usual in current practice. Consequently, this afforded clearer 
insight into the effects of those procedures. 

3. New planes can be learned at almost twice the usual rate with no 
impairment in efficiency, in comparable length of time to the other 
teaching procedures, by the rapid-presentatiou-plus-review procedure. 

^In addition, there Bcoms to bo a greater tendency to use inadequate and trick 
recognition features. At the end of the courao atudenba wero asked to confess any 
trick cues they had been using. Group II seemed to excel in their use. 
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There ia strongly suggestive evidence that it is the most effective of the 
procedures used. Its superiority may be the result of a longer period 
of time during which all planes have been seen and a longer period of 
time for stressing those planes which present the most difficult differentia- 
tion problems. 

Since the procedures for Group III and IV were found to be most 
efficient, a combination of both might give greater efficiency than either 
one separately. This is one interesting possibility for further researcli- 

Summary and Conclusions 

Four equated groups, of 8 pre-aviation (V-5) students each, were 
taught aircraft recognition in a standardized manner. The major 
experimental variable in each group was as follows: Group I, 1/50'^ 
exposure time; Group II, only three views of each plane; Group III, 1'' 
exposure time; and Group IV, presentation of the entire syllabus in 
almost half the usual time, followed by a review emphasizing confused 
planes. 

The following conclusions were obtained. 

1. The use of 1/50'^ exposures as part of training in which an ap- 
proximately equal number of longer exposures are given has no 
ascertainable advantages over 1" exposures similarly given with 
longer exposures. 

3, Eestriction of teaching materials to only three views of each plane 
results in learning which generalizes poorly to views of planes 
other than those taught and is, in this sense, inefficient. 

3. Rapid teaching followed by review of confused planes ia probably 
the most efficient of the procedures tested, 

These findings might be useful for incorporation in actual training 
courses. 

The battery of tests which was found (4) to be important for deter- 
mining the final level of performance will now make possible a more 
complete equation of groups and therefore future experiments which can 
yield more definite answers to problems such as the above. 

Received October 18, 1944- 


References 

1. Batmerj A. The effect of practice on the perception and memorization of digits pre-^ 

sented in single exposure, Ph.D. thesis, Ohio State University, 1935. 

2. Bennett, S. The visual perception of English words of various lengihs in iachistoacopic 

czpomres of 3 milliseconds. M.A. thegia, Ohio State University, 1940. 



398 


Lester Luborsky 


3. Knighli, 0. D. The role of the figure-ground rehticn in perceiving and mmorizing 

visual Jorms. Ph.D. thesis, 01iioStat<) University, 1036. 

4. Luborsky, L. Aircraft recognition: IL A study of prognostic testa, /. appl P&g- 

chol (in press), 

6. McIntyre, S. G. The role of su?nina(ton and of some other mriaiiom of impressioa 
in the perception and memory for visual forms, M.A. thesis, Ohio Stale Univer- 
Bity, 1939. 

6. Pitkin, W.> Jr. WhaCs that plane? (3rd Ld, rov.) Washington, D. C., nnd New 

York: Infantry Joumal, Penguin Books, 10-13. 

7. Saville-Snenth, R, A. Aircrafl recognition. (3rd Kd.) Wasliington, D, C., and 

New York: Infantry Joumalj Penguin Books, 1043. 

8. Schwarzbek, W. C. Some fcidors u;/iich infLueiKO ttie nnprcssioR and immedicte reprO' 

ditclion of digits, Ph.D. tlicaia, Ohio State University, 1036. 

9i StaS, Pay chologi cal Test YUm Unit. History, orgnnkntion, and reaenreh activibiea, 
Psychological Test Filin Unit, Army Air Forcea. Psychol. Dull, 1914, 41, 467- 
408. 

10. Steckle, L. C. The relative elRcicncy of ainglo voraiis multiple exposures in tlio 
rapid memorization of visual forma, Denison University Bulletin, J. Sci, Labora- 
tories, 1940, 35, 1-3L 



Magazine vs. Personal Interview Votes in the Consumer 
Jury Advertising Test 

Lester Guest 
The Pennsylvania Stale College 

For many years the consumer jury or opinion method of testing the 
effectiveness of advertisements has been a useful device for estimating 
the relative effectiveness of advertisements before they appear. In 
essence, respondents are usually personally interviewed and asked which 
of several advertisements interests them the most or would most likely 
influence them to buy. 

The completeness of the make-up of the advertisements at the time of 
the test, the number of advertisements that can be judged at one time, 
and the form of the question posed the respondent have all been subjected 
to research (1) (3),’ It has been conceded that, as in all sampling studies, 
the sample should be representative of the purchasers or potential 
purchasers of the product in question. The final answers to some of the 
other problems await some sort of definitive criterion of effectiveness. 
However, assuming that respondents’ stated preferences are automatically 
valid for the degree to which they would be likely to read an advertise- 
ment, some questions can be tentatively answered. 

In regard to the form of the qiiestioii, the consensus scejns to indicate 
that respondents should be asked to select the advertisement which 
appeals to them the most, or that interests them the most, or the adver- 
tisement that would most likely lead them to buy, rather than asking 
them to select the desf advertisement (2, p. 309) (3, p. 124), (There am 
those who say that the wording makes little, if any, difference (1, p.‘ 18).) 
The reason for this distinction in question wording arises from the belief 
that the interviewee should be asked to react to the advertisement as 
a consumer and not as a criHc of advertising. From the current point of 
view, there is no best advertisement apart from the reader's own prefer- 
ence. Prom a practical point of view, it makes no difference whether 
the advertising expert believes that a certain advertisement has the best 
headline, general layout, and illustration, if the public concerned dislikes 
that advertisement and prefers another. Therefore, the question asked 
the respondent should not lead the respondent to believe that he is 

‘ Unpublished data from several sources also give information on these points, 

39Q 
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mtitching 'vvits with experts, but should let him foci free to react as he 
usually actSj not as he should act. 

With respect to sampling problems, it 1ms been shown that coupon or 
mail responses arc not usually representative of tlie general population 
or of a spceifiG mailed sampling. This is sometimes due to dilution or 
inflation caused by the liahitual coupon clipper, or even more discon- 
certing, the inertia of the temporarily clisiiiterc, sled individual or the over- 
zealous individual who has a special interest in the problem at hand. In 
addition, Link (3) points out that mail inquiries allow respondents too 
much time for critical evaluation which may lend to distortion. 

The author recently had an opportunity to study the following 
questions in respect to consumer jury responses; (1) what effect docs the 
form of the question have upon preference for an advertisement, and (2) 
what differences, if any, result from a comparison of magazine ballots 
vs. personal interview ballots? 


Procedure 

The advertisements in question were printed in the interests of a well 
known, nationally distributed drug product. The original advcrtisc- 
ment in reality consisted of two advertisements placed side by side on a 
full page of a national magazine. The headline of the complete ad- 
vertisement asked the reader to indicate which ad he or she voted for, 
with a small subscript challenging the render to ^%atch wits with the 
experts/' The two advertisements then appeared, followed by a short 
bit of coi^y and a coupon. In return for the reader's reply, lie was to 
receive a free sample of the product. These two advertisements will be 
referred to as A and B, Advertisement B subsequently appeared singly 
in three other national maga 2 ine.s, but Advertisement A never appeared 
elsewhere. 

The double advertisement asked the reader which advertisement 
was the hdler. In order that coupon replies and personal interview 
replies be comparable it was imperative that the personal interview 
question also ask which advertisement was better. However, it was 
thought desirable to check the influence of wording the question in this 
fashion with wording believed to be more appropriate, i.c, ^hnosi inter- 
esting.’' Therefore, the questionnaire vvns constructed with this aim 
in view. 

Two forms of the qiiestionunire were constructed, each asking for 
data concerned with usage of the product, recognition of the advertise- 
menta, and readership of the magazine in which the advertisements 
originally appeared. In addition, each person was asked which ad- 
vertisement interested him more and which advertisement lie thought 
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was Idler. On Form A of the questionnaire, the '^teresi” question 
prececlecl the better qucstionj and on Form B the order of these two 
questions was reversed. Other than this, the two forms were identical. 
Additional data were secured bearing upon the respondent's age, sex, and 
economic status. 

Proofs of the original advertisement were obtained and by appropriate 
cutting were made into two separate advertisements, each as they might 
appear singly. Tiie-se wore presented to the respondent simultaneously, 
but the right-left position was systematically varied to avoid any time- 
order error. In the original maga&ine appearance this was of course 
impossible. 

A total of 304 interviews were conducted by experienced interviewers. 
These were done about 2 months after the appearance of the original 
advertisement and were stratified into the conventional A, B, C, and D 
economic groups. Half of the interviews were done with each form of the 
questionnaire, and half were done with each sex. No attempt was made 
to control the age distribution, although the approximate age was noted 
for each interviewee. Geographically, the interviews were done in cities 
and small towns distributed along the eastern coast. 

Several internal checks of the data indicate that the sample was 
reasonably representative. For example, although no effort was made 
to intei'view the some number of men and women with each/orw of the 
questionnaire, about one-half men and one-half women were found to 
have been interviewed with each form. Similarly, although economic 
status for the Avhole 304 interviews was stratified, no attempt was made 
to stratify mlhin one questionnaire form. However, approximately the 
correct proportions were maintained by form of the questionnaire. 
Finally, about the same number of users of some Irand of the product 
were found to have been interviewed with each form of the questionnaire. 

EesuUs 

The data presented in Tables 1 and 2 refer to the material collected 
from all interviews irrespective of the form of the questionnaire used. 
Cases where respondents refused to choose between the two advertise- 
ments have been eliminated throughout to facilitate comparisons. 
These constit^itcd only 10% to 12% of the cases and their elimination 
did not materially change the results. The category 'interesting'^ 
always will refer to the question phrased using that word, and the category 
''better^' will refer to the question using the word beUer. Table 1 indi- 
cates that in all compariaons Ad A was judged superior regnrdles.s of the 
question asked or the way the data were collected. A^s superiority 
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Table 1 


Per Cent for each AdvcrLiacmcnt in Total Interview Group and Coupon Group 



Ad A 

Ad D 

N 

Personal Interview 

Intei'ealing 

63% 

‘17% 

2G6 

Better 

5S% 


27(1 

Coupon 

Better 

59% 

41% 

239 


Table 2 

Per Cent for each Advertisement According to Economic Statua, Sox, and 
Use of some Brand of the Product 


More III teres ting BeUcr 




Ad A 

AdD 

N 

Ad A 

AdB 



A 

59% 

41% 

29 

55% 

45% 

2fl 

Economic 

D 

61% 

49% 

63 

00% 

40% 

67 

Status 

C 

52% 

48% 

104 

57% 

43% 

107 


D 

5-1% 

40% 

80 

57% 

43% 

81 

Sex 

Male 

55% 

45% 

125 

00% 

40% 

131 

Eemiilo 

51% 

49% 

140 

55% 

45% 

142 

Use of aornu 

Users 

50% 

60% 

103 

54% 

40% 

105 

brand of Lhe 

Non-uscra 

56% 

45% 

103 

60% 

40% 

169 


product 


* Only 3% of the total group of rcBpondciits used the brand of the product advertised 
and therefore this group waa considered too small for any atntisbicnl anulyais. 

increases when '^better'^ was asked in the personal interview and agrees 
closely with coupon returns in this case. 

In no case, however, did the critical ratios between these differenccfj 
reach 3. The diffcronce of 18% in favor of Ad A in terms of coupon 
returns yields a critical ratio of 2,83, or over 99 chances in 100 that the 
diffeTcncc is not the result of sampling errors. Likewise, the diffcrenco 
of 16 in favor of Ad A from the personal interview returns when ^Tetter’' 
was asked gives 99 chances in 100 that the difference ia not tlic result 
of sampling errors. 

When the data are fractionated for economic status, sex, and use of 
some brand of the product, the base N's become too small to yield any 
statistically significant differences. Plowever, such breakdowns can give 
suggestions as to the possible groups from which coupons were returned 
in order that Ad A receive 59% of tlie votes. Therefore, these data are 
presented in Table 2, 
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Some of these percentages agi^ee quite closely with coupon returns^ 
far example, tho percentage of men picking Ad A as better, the non-uaers 
picking Ad A as better, and the B economic group selecting Ad A as 
better. From this, it loolcs as if coupons might have been returned with 
a greater frequency from men, the B economic group, and non-usera 
of the product, otherwise coupon returns would not agree as well with 
personal interview data. As a matter of fact, it is known that coupona 
wore returned willi men^s signatures more frequently than with women^s 
signatures when the coupon returns were broken down for sex, 60% of 
men prefer Ad A and 55% of women prefer the same advertisement. 
This agrees perfectly with tlie interview data for sex on the same form 
of the question. The coupons did not contain data allowing other 
fractionations. 

It will be recalled that on one form of the questionnaire, ^^interesi’^ 
was aslced first followed by better” and that this procedure was teyersed 
on the other form. The previous tables present the data grouped by 
question form but summating responses irrespective of the order of the 
questions. To make the most legitimate comparison with coupon re- 
turns it is necessary to consider only responses to the question asking 
which advertisement is better on tho personal interview questionnaire, 
unbiased by a previous question asking which advertisement is more 
inLeresting, To do this, responses were tabulated separately for Form 
B of the questionnaire and only for the question asking for the ^^better^^ 
advertisement. This question appeared first on this form. Table 3 
gives these results. 

Table 3 


Per Cent for each Advertisement According to Economic Status, Sex, and Use of the 
Product for the 'Tetter'^ Question Only and When it Appeared First (Form B) 



Total Groups 





Ad A 

AdB 

N 

Coupon (Better) 


so% 

41% 

239 

Personal Interview (Better) 

53% 

47% 

135 

Pmetionabions for Personal Interview 



Ad A 

AdB 



A 

B0% 

50% 

14 

Economic 

3 

00% 

40% 

30 

Status 

C 

S8% 

42% 

53 


n 

39% 

01% 

38 

Sex 

Male 

55% 

46% 

C4 

Female 

61% 

49% 

71 

Use of some brand 

Users 

51% 

49% 

53 

of the product 

Non-usera 

54% 

40% 

82 
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Here again, the N's are much too small to yield any statistically 
significant differences but the results shown here suggest that coupons 
probably were returned most heavily from the B economic group in order 
that 59% of magazine voters could have selected Ad A, On the whole, 
it is probable that coupon responses overestimate the * 'superiority^' of 
Ad A even in terms of "betternesa.” (Tlie ciitical ratio of the difference 
of 18% in favor of Ad A yielded by magazine votes ia 2,83 wliereas the 
critical ratio of the difference of 6% in favor of Ad A yielded by personal 
interview results is .70.) 

Another factor that could have led to the large majority of coupon 
responders selecting Ad A was the fact that Ad A always appeared on the 
left position in the magazine whereas the right-left position was alternated 
in the personal interview. Other studies have shown the influence of 
time-order error and it is conceivable that it operated in this instance (1). 

It is obvious that differences arise not only from the form of the 
question but also from the effect early questions in the questionnaire 
have upon other subsequent questions. Table 4 presents material upon 
this factor. 


Table 4 

Influence of the Order of Queations upon Frefcronco for an Advertisement 



Form A 



Form B 




A 

B 

77 

A 

B 

7^ 

Interest (Ist) 

66% 

45% 

132 

Better (let) 63% 

47% 

135 

Bettor (2n(l) 

63% 

37% 

130 

Intorcat (2nd) 61% 

40% 

134 


The material in this table shows again that Ad A is superior in every 
comparison, but the degree of superiority varies depending upon the 
context of the question. It seems that from a pure interest point of 
view, Ad A is picked by 10% more people than Ad B, but when followed 
by a question referring to “better," Ad A's superiority jumps to 26%. 
(The critical ratio of the latter difference ig 3.17. In all other com- 
parisons in Table 4 the critical ratio approached zero.) On the other 
hand, if “better" ia asked first, followed by “interest," the change ia only 
from 6% to 2% in favor of Ad A. It looks here as if, once a person has 
said that an advertisement is better, there is less likelihood of his turning 
about-face and choosing another advertisement as more interesting, but 
if he has picked an advertisement as more interesting, then ia confronted 
with a question inferring that there ia such a thing as a “better" advertise- 
ment, he may be more prone to change his choice. The data presented 
in Table 6 indicate that the large majority of people do not change their 
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original selection, but that those who do change materially alter results 
for the total group. 

Out of 152 auHwera to Eorm A, 107 made no change, and out of 152 
answers to Form B, 109 persons made no change. Therefore, the ap- 
pearance of cither question before the other is not especially conducive 
to change of choice. However, considering only those that changed 
preference, when better precedes interest, the changes were about evenly 
split, whereas, when interest precedes better, twice as many persons 
change to Ad A as change to Ad B. (The critical ratio in the latter 

Table 5 

Major Changes in Choice of Advertieement by Form of the Questionnaire 


Form A Form B 

(Interest— hotter) (Bettei;— interest) 


Changca to 

Changes to 


Changes to 

Changea to 


B when aslccd 

A when naked 

N 

B when asked 

A when naked 

AT 

"better" 

"bottor” 


“interest” 

"in teres t'* 


33% 

Q0% 

45 

40% 

61% 

43 


instance with only 45 cases is 2,37.) Evidently, there are some factors 
in Ad A that respondents who originally select B as interesting feel 
experts agree upon as better. What those factors are is not obvious 
from the present analysis, 

An interesting commentary concerning the whole study is that al- 
though Ad A always gathered the majority of the votes (sometimes 
small), Ad A was never published as a separate advertisement, whereas 
Ad E ran separately three times. This supports the contention that the 
copy writer, although ho may be an excellent judge of an advertisement 
for himself or a small number of people like him, may not estimate in 
advance which of several advertisements will please the majority of the 
reading public with which he is really most concerned (3), 

Conclusions 

Any conclusions drawn must of necessity be interpreted in the light 
of the fact that, due to the relatively small number of cases interviewed, 
most of the differences do not yield critical ratios of 3 or more. However, 
in several of the more pertinent comparisons, the chances are greater 
tlian 90 in 100 that the obtained differences are not due to sampling 
errors. Kemembei'izig the limitations of the study, the following con- 
clusions may be drawn- 
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1. A comparison of the results of a consumer jury test carried out by 
magazine votes with one carried on by personal interview indicates that 
the two give different results. Magazine returns indicated 59% for 
Ad A whereas the most legitimate comparison figure for the personal 
interview group was 53% for Ad A. The critical ratio of lire difference 
is 1,12, or 87 chances in 100 tlmt the difference cannot be explained in 
terms of sampling errors. At least one other study has shown a similar 
discrepancy (3, p. 119). 

2. The differences found between magazine and personal interview 
results may be a result of unrepresentative sampling of coupon responses. 
It appears tlmt the middle economic groups' responses more nearly 
approximate coupon returns than other groupings, The magazine in 
which the original advertisement appeared would tend to be read by the 
top economic groups more than the lower groups. 

3. There is a possibility that a time-order error may be introduced 
in magazine voting and that this can be balanced out by a properly 
controlled personal interview study. 

4. The form of the question has an important heaving upon results 
obtained. Different responses are obtained when a person is asked to 
select the better of two advertisements than when ho is asked to choose 
the one that interests him the most, It is likely that the latter form 
will give a truer picture of him as a consumer than the former form. 

5. For some people, the answers to a question will be unduly influenced 
by preceding questions and answers. 

lieceioed September S, J94^, 
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Woolpert, E. D. [Ed.] Municipal Personnel AdrninisiTaiion. (3rd 
edition.) Chicago: International City Managers' Assoc., 1942, Pp 
xm- 429. S57.50. 

MunicipaliLics and other juriadictiona entertaining the idea of installing a personnel 
fiyafcem, contemplating the institution of an in-service training program or seeking o. 
comprehensive, realistic guide to workable aolutiona of personnel problems should 
consult Municipal Personnel Aiminhitdiion. This book is published by the Interns^ 
tional City Managore' Association os the ninth volume of ita aoriea on municipal 
administration. 

While public ofhciala arc inclined to be interested in specific problems; rather than 
general practices and trends, they alioulcl be ever mindful of the need for perspective 
and long-range policies and prograrae. Accordingly, this volume consists of more than 
expedient devices for the practitioner, The first chapter on the personnel problem 
does just this by providing a broad background and a setting for the more specific 
diacusaions of personnel problems which encompass the remainder of the volume. 

The need for a rational organization of personnel activities is the first specific per- 
sonnel problem conaidcred. It is indicated that the dimensiong and complexity of this 
problem require poaitivo, concerted effort for effective solution, A basic requirement 
for dealing adcc^uately with this personnel problem is to have defined clearly the respon- 
sibility for the administration of such activities. This personnel problem exbta even 
in the Bmallcr cities where it is not always feasible to have a separate personnel agency, 
However, it Is pointed out that these cities must recognize regardless of working force 
the existence ot such problems os classification^ rates of pay^ recruitment; hours of work, 
attendance, and leaves of absence. The text outlines eeveral ways whereby these 
municipalities can meet their personnel problems. The dominant theme is that varia- 
tions in structural patterns of personnel organ! siatioa should not bo taken seriously as 
long ng they result from the application of sound general principles to different local 
sitliations. The basic problem of organization is solved when the work is analyzed and 
the methods and resources available are considered and evaluated. 

In the ensuing several chapters where the principal phases of personnel administra- 
tion are conaidcred, an attempt haa been made to outline standards of administration oa 
guidepoflta for individual personnel agencies. In the chapter on position-classification; 
it is shown that information relative to the duties and responsibilities attached to the 
various individual positions within a given service is of primary importance in the 
development of a personnel program. Accordingly a position-classification plan de- 
signed to eecure and utilize these facta should be one of the first aims in preparing and 
adminiateting a personnel program. After stating the nature and objectives of poaition- 
classification, serious attention is given to the development of a classification plan, the 
problems entailed in introducing the plan, and the basic requisite of continuous adminis- 
tration of the plan. 

In a conciflc, yet complete, chapter on salary and wage administration, it is shown 
that the intangible advantages of public employment about balance the disadvantages. 
A workable outline ia presented for thoae seeking to attain the principal objective of a 
pay plan— equal pay for equal work. 


407 



408 


Book Reviews 


In Chapter 5 the reader finds an objective discusaion of problems involved in the 
recruitment and eelecLion of qualified personnel for public service. After indicating 
the relation of recruitment to classification, there is presented the various forms and 
methods of examining or testing applicants in selecting employees with a capacity to 
learn. In logical sequence there follows a chapter on employee training in which there 
is found most of the elements entailed in the organisation for and methoda of training. 
The point is made that the appropriate method of training shoiild be determined prag- 
matically, on the basis of utility and applicability- In Chapter 7, considerable attention 
is given to the methods of appraising, through promotional test, the capacity of em- 
ployees for promotion, Personnel administrators arc reminded that tlioro is an inverse 
relationship between the need for specific knowledge, the factor which a wcll-construcLcd 
examination can measure reliably, and the level in the orgnnimtional hierarchy which 
an employee occupies. The higher one goes in the organizational ladder the greater 
should be the emphasis Upon capacity for administration. 

The problem of reports of performance is treated in an unbiased manner. Tlio 
evaluation of employees is regarded as an essential part of administration since it is 
quite common to find disparity between ability and performance. In any balanced 
personnel program determination of knowledge, skills, end aptitudes should be supple- 
mented by mcasurca of employee performance. Various types of rating systems are 
described and an effort made to evaluate the degree of auccesa found with each. The 
analytic checklist type eeemB to be fiivoicd because it tends to eliminate the weakness 
of evaluation by the rating officer prevalent in tho graphic rating scales. 

What has been presented to tl}ia point ia regarded as tho slccleton of an effective 
personnel program, Tho chapter on morale and conditions of employment includes 
other elements which enter into such a program enabling it to give maximum service to 
tho community. The quality of supervision within an organization is preaenLed as tho 
most important factor in building and maintaining high morale, Ciosely related to 
the question of morale is the complex matter of discipline. While favoring some form 
of disciplinary process, similar to the employee scIf-diacipUno plan inaugurated in the 
refuse collection division of the Los Angeles city government, reaponBibio officials are 
cautioned against copying without discrimination this or any other plan as a general 
mode!. Since self-discipUnc can beat be developed and maintained through the organi- 
zation of employees themBclves, the following chapter on employee relations delves into 
tho many ramifications of the personal equation in administration, particularly as they 
relate to the development of a municipal employee relation policy. As the final element 
of a comprehenflive perBonncl program, Chapter 12 goes into tho ramificationa of a 
properly planned and administered retirement system. While the personnel adminis- 
trator docs not usually administer the retirement system, it ia advised that he participate 
in the planning phases because it plays an important part in the development and 
maintenance of cfTective government. 

After covering the broad background from recruitment to retirement, Chapter 13, 
entitled "Special Administrative Problems,” presents several aspects or phases of per- 
son ncl administration which have to do with the overall administration of a personnel 
program, rather than with the program per se. They include such iteina oe personnel 
rules and regulations, personnel forms rind recorda, research, measurement, and public 
relations. 

Practitioners, namely administratora, personnel psychologists, and hcada of oper- 
ating departments and agencies, will find the book extremely valuable in developing 
workable solutions of personnel problems. The approach ia primarily utilitarian, with 
emphasis upon day-to-day peraonnel problems which confront the aforementioned. 
The discusaiorifl in the book horve achieved A high degree of realiam through a procesa of 
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selecting curcrully flpccific problems, techniQuea and procedures derived front th6 
authors own. experiences and observations. In all the diSQUBsione there is do pretenso 
of presenting a detailed manual or a model system of municipal adminiabration. 

The tone and outlook of the book in general is objective and practical. The object 
ig not to suggeab complete ovcrlmulinE of peraonnel adminiatration overnight where 
obvious disparity exists between accepted etandarda and practices in given organiza- 
tions. Instead, the personnel officer is made to realize that ehnngea for the improvement 
of public service muafc be introduced by progressive steps. 

Progressive municipal olhciala and perBonnel psychologisla can hardly afford to do 
without this volume designed oa a ptncUcal guide* The general administrator will find 
it very useful in delineating the principal techniquea derived by personnel experts and 
learning the relationship between these techniques and management problems confront- 
ing tiio chief administrator and his department heads. The personnel officer will find 
the text indispensable for two reasons: first, the principles and activities of a compre- 
hensive personnel program are developed from discussiona of the peraonnel problem; 
and second, the position of personnel administration in the broader framework of ad- 
ministrative management is portrayed quite effectively. In addition, students of mu- 
nicipal administration, particularly those interested in public service careera, will find 
the book most profitable in obtaining a balanced picture of the interests and approaches 
of the administrator and the personnel officer. 

John K, McKay 

Colijomia Stale Peraonnel Board 


Melville, S. Donald. Color vision, Reprinted from The Oplametric 
Weekly i August 24, August 31, September 7, and September 14^ 1944, 
pp. 19. 

The author of this article baa given a condensed version of the physiology and the 
psychology of color vision. In moat respects the sources cited are up to date and ade- 
quately evaluated. However, the field is one in which bo much activity is going on 
currently that one should be careful to accept any crystflUiBation as final. The psy- 
chology of color is not given as a psychologist probably would give it, who is parbiDUlnrly 
interested in the field, but it touches upon most of the facta. 

The article works up to. a final topic which is probably of considerable interest to 
readers of the W eeklVf namely, abnormal color vision and testa for color vision. Most 
of the current tests arc described briefly but no thorough-going evaluation is attempted. 
The only new material is derived from some testa by the author on the treatment of 
color blind individuals. His interpretation of these results is in line with other studies 
which give no indication that color blindness can be altered by dietary or training 
methods. A liafc of fi9 references is appended, which, while not exhauatiye, gives a good 
sampling of the field. Undoubtedly the article answera very weU the purpose for which 
it was written, namely, that of informing a particular group of professional men con- 
corning a field related to their profe^ion. 

Forreat Lee Dimmick 

Hobart ColUgOf 

Geneya, JVeuJ York 


j 



410 


Bi7cl^ Itmews 


MacKintoahj J. M. The mr and menial health in England. New York: 
The Commonwealth Fund, 1944, Pp, 9L $.85. 

This book coiisiaLs of a scries of informal essays on laontal health in England during 
the first four years of the present World War and the outlook for the PoatAViir period. 
Part One entitled The ivivact of war covers The 7 ;rocess of adjuslmcnt^ 1939-/, Of The 
lonely year, 1940-41, Defense, preparation and alliance, 191^1-4%^ and The end of the 
heginningf 1942-43. Part Two entitled ilohilizalionfor peace covers Hospital serviceSf 
Voluniary organhaiions for menial healih, Professional education in vwHal hcaUh, and 
proWewis of IhefutiiTe, Much of the content consists of cither anecdotal material 
or gcneralizationg (or which little supporting data arc introduced. The general point 
of view that scientific services, mental hcaltli, education and propaganda can make a 
great contribution both to war and peace is one with which few will disagree. But 
the professional person, however mucli ho may enjoy tin* style and manner of presenta- 
tion, may well fed tliat the book is somewhat vague and over-optimistic with regard 
to the contributions that can be made and quite lacking in concreteness and specificity 
aa to their chavactcr. 

John E. Anderson 

VniversUy of Minnesota 
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Mental disorders in later life. Edited by Oscar J. Kaplan. Stanford University; Stan- 
ford University Press, 1946. Pp. 430. S5.00. 

The governing of men, Alexander H. Leighton. Princeton: Princeton University Press, 
1045. Pp. 460. 83.75. 

The prediction of success for students in teacher education. Lycia 0, Martin. New 
York; Bureau ol Pubheations, TcacJjcrs College^ Columbia University, 1915, Pp, 
120. S2.00. 

Unconsciousness. James G. Miller. New York: John Wiley & Sons, 1042. Pp> 329, 
33.00. 

Prediction of the adjustment and academic performance of college siudsnis by a modification 
of the Rorschach method. Ruth L. Munroc. Stanford Umvcrsityi Stanford Uni- 
versity Press, 1945. Pp. 06. 81.25. 
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man, Inc. Pp. 230. $3.00. 
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The Accuracy of Precision Instrument Measurement 
in Industrial Inspection * 

C. H, Lawshe, Jr., and Joseph Tiffin 

DiliBion of Education and Applied Paychology, Purdue Vnivemly 

Modern industrial production is becoming more and more dependent 
upon the accuracy of precision instrument inspection. Thousands of 
employees have been trained in the use of precision measuring instru- 
ments, and future industrial developments almost certainly will require 
still greater emphasis on the accuracy of measurement to insure produc- 
tion which satisfies the fine tolerances of modern precision equipment, 
Virtually every precision instrument calls upon the operator to exercise 
judgment in determining proper “feel/^ ''tension/* "drag/' or other char- 
acteristics. In spite of all that is known about the variability of human 
judgments, little attention has been given to the importance of such 
variability as it may affect the accuracy of precision instrument measure- 
ment. The purpose of the investigation repotted in the present paper 
was to examine the accuracy and variability of employee measurements 
with certain precision instruments. 

Sources of Data. Data were collected in two different plants. The 
first of these is engaged in the manufacture of variable pitch propellers 
for aircraft and the second in the manufacture of precision parts for 
aircraft and automobile engines. There is no evidence that the survey 
results obtained are any better or any worse than those whioli would be 
obtained in other plants of a similar character and there is every reason 
to believe that similar results would be obtained if the survey were 
projected to other plants. 

An Inspection Department Survey 

Job Analysis. Approximately 200 people are employed in the inspec- 
tion department of the first plant. Their jobs were analyzed by job 

^ The authors acknowledge the asaistanco of Mr. 0. D. Loscoe in establishing the 
"true'' dimeneiona and of Mr. R. N. Purcell in doing most of the atatiaticol work in 
connection with the second part of the study. 
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classifications in order to determine whnt preciaion instruments are used 
and what tolerances arc demanded on each job. Frequency counts were 
then made to determine which instruments or combinations of instru- 
ments are used in the largest number of classifications and by the largest 
number of employees. On the basis of this count, twenty instruments 
and combinations were chosen as being moat important in this particular 
plant. 

A Dimensional Control Laboratory. A room was set aside as a dimen- 
sional contiol laboratory and twenty booths or inspection stations were 
set up. Each booth was numbered and in it were placed one of the 
twenty instruments, a standard part from the plant, and a simplified 
working drawing which indicated one dimension to be measured with the 
instrument provided* When an employee entered the room, the attend- 
ant determined his job classification and provided him with an appro- 
priate work-sheet for each of the stations containing work samples from 
hia job* Each employee was tested on only those inatrumenta which, ho 
uses on his particular job. He was encouraged to make five measure- 
ments and then to record his best judgment as to the dimension. The 
readings thus obtained were compared with so-called “truo^^ dimensions 
which were determined by means of ultra-precision instruments in com- 
bination with Johansen blocks. Instruments utilized in the performance 
testing were checked and adjusted periodically to insure constancy. 

Emphasis of Testing. This performance testing procedure was organ- 
ized in connection with a training program and its primary function was 
to identify persons in need of training. Plans for a maintenance pro- 
gram were also made with provisions for re-testing employees every three 
months. It was also planned to utilize the laboratory to supplement 
seniority in determining adequacy in connection with transfers and pro- 
motions. The program was instituted with the knowledge and backing 
of line supervision and of the union in the plant. There is every reason 
to believe that nearly all of the employees approaches the test situation 
with a favorable attitude. 

Results 

Results obtained at eleven of the twenty stations are presented in 
Figure 1. The particular stations selected for illustration were chosen 
in terms of general familiarity with the instruments used and not because 
of ony peculiarity in the findings; they are truly representative. 

In Figure 1, the open bars represent the percentage of inapectora 
tested who obtained readings within the established tolerance. The solid 
bars represent the percentage of persons tested who failed to meet the 
standard. As already stated, not all of the inapectora were tested at each 
station; instead, the sample contains only those who use the inatrumenta 
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on their jobs. This accounts for the fact that the N’s range from 117 
to 162. The figure indicates that the percentage of inspectors meeting 
the various standards ranged from a high of 66% on the inside microm- 
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Fig. 1. The percentage of inapectors passing and failing various precision TncEsuring 
instrument performance teats in an aircraft propeller plant. The open bars indicate the 
percentage meeting the standard and the solid bars indicate the percentage failing. 


eter to a low of 9% on the inside caliper in combination with the six-inch 
micrometer. The pattern of performance on the various vernier microm- 
eters also eeemg aignificant. It will be noted that 43% of those tested 
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met the standard with the one-inch micrometer, 17% with the two-inch, 
and only 11% with the six-inch. The varying tolerances established for 
the instruments are the same as the tolerances which job analyses indi- 
cated had been established by the engineering department and are 
identical with those encountered in the shop. 

A Tool Room Survey 

Procedure, Because many of the cm]>loyccs in the plant just de- 
scribed were new and were drawn from a “tight^’ labor market, a related 



ViQ. 2. The percentage of toolmakers [N = 46) who obtained vernier micrometer 
meoaiirements within ,0001 inch of the "true** dimension on each of nineteen parts. 
The base line indicates the approximate size of the dimension and the code indicates 
the shape of the part measured, 

study dealing with experienced toolmakers was set up in a plant engaged 
in the manufacture of precision parts for aircraft and automobile engines. 
In this study, 45 men were selected from the tool room. Their ages 
ranged from 17 to 62 years, their experience with the company from five 
to twenty-nine months, and their experience on their present jobs from 
one to twenty-nine months. For the moat part, the job classifications 
of these men fall in higher labor grades than do those reported in the 
inspection department study. 

The study was limited to the use of vernier micrometers and employed 
nineteen parts to be measured. Five parts were cylindrical, five rectan- 
gular, five spherical, and four were inside diameters. Here again, each 
employee measured each part independently five times and the reading 
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recorded wag the best judgment he could make as to the '^true” reading 
on the boais of these trials. After all readings had been completed by 
all of the men, the parts were measured with ultra-precision instruments 
and Johansen blocks in order to obtain tlie closest possible approxima- 
tions to the *^true^* dimensions against which to compare the measure^ 
menta made by the men. 

Accuracy Results. No significant correlations were found between 
accuracy of measurement and either age, length of experience with the 
company, or amount of time on the present job. The percentages of 
accuracy are shown in Figure 2. On the baseline of this figure is plotted 

U) 

o 


o 



3. The variability of the vernier micrometer njcaBuremDnta of 45 toolmakera 
on each of ninebcon parts. The base line indicates the approximate size of the dimen- 
sion and the code indicates the shape of tho part mensured. 

the approximate size of the part. On the Vertical axis is plotted the 
percentage of readings correct to .0001 inch. It will be noted that the 
parts vary in size from approximately ]4 inch to approximately 6)^ 
inches. Each of the four lines plotted in Figure 2 shows the percentage 
of readings within ,0001 inch of the "true" dimensions for parts of a 
certain shape according to the code indicated in the figure. Thus, for 
cylindrical parts, about inch in size, 73% of the readings were accu- 
rate to .0001 inch. For cylindrical parts approximately 3 inches in size, 
however, only 12% of the readings were accurate to .0001 inch. 

Variahility Results. The results plotted iu Figure 2 assume the accu- 
racy of the so-called "true'^ dimension. The validity of these ''true^' 
dimensions is always open to question in spite of the ultra-precision 
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methods used. Therefore the (lata were analyzed in another way to 
show the variability of the readings obtained witliout reference to the 
“true'^ dimensions. This analysis of the results is plotted in Figure 3. 
Here again the approximate size of the part in inches is plotted on the 
baseline. The vertical axis on this chart plots the interquartile range of 
the readings. This may be interpreted to mean the range of the middle 
60% of the readings under each condition of .si?ic and ,shai)c of the part. 
For example, looking at the solid line plotted in Figure 13, it will be noted 
that when the pert is cylindrical and approximately Yz inch in size the 
interquartile range of readings, or the middle 50%, is .0002 inch. This 
means that 50% of the readings were within a range of .0002 whereas 
the remaining 50% of the readings varied by more than .0002, eithev 
above or below of the range of the middle 50%. In like fashion, it will 
be noted that when the part is cylindrical and approximately 2^ inches 
in size, the middle 50% of the readings fall within a range of .0003, 
whereas the remaining 60% of the readings on this part fall more than 
.0003, one way or the other, from this range. 

Summary and Conclusions 

Controlled performance test.s with various precision instruments were 
administered in two industrial plants. In one jdant 200 inspectors were 
tested on a variety of instruments used in their respective jobs. In the 
other, 45 tool room employees weie tested on vernier micrometeva with 
parts of varying sizes and shapes. 

In general, the following conclusions arc supported: 

l,,The accuracy of precision instrument usage is probably consider- 
ably lower than is ordinarily assumed by those responsible for methods 
and standards. In one plant the percentage of inspectors meeting the 
standard ranged from 06% on the use of the inside micrometer to 9% on 
the inside caliper in combination with the six-inch micrometer. 

2. In the population studied, micrometer reading accuracy did not 
correlate significantly with age, amount of experience with the company, 
or length of time on the present job. 

3. Gross size of the part is apparently a factor in the accuracy of 
micrometer measurement. Under optimal conditions in the second plant, 
not move than 80% of the readings were accurate to .0001 inch and with 
larger parts, ranging from 3 to 6 inches, only about 20% of the readings 
were accurate within tliese limits. 

4. Gross size of the dimension is likewise related to tlie variability of 
measurements, As the parts increase in size, regardless of .shape, the 
spread of the readings becomes greater so that for large inside diameters, 
50% of the readings vary by .0008 inch from the other 50% of the 
readings, 
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5. The results suggest that while inside diameter measurements are 
more variable than measurements of cylindrical, rectangular, or spherical 
dimensions, the percentage of measurements meeting the standard of 
±.0001 inch is no loss, However, the problem of the relationship be- 
tween shape and both accuracy and variability is open to further 
investigation. 

C. The necessity for the development of training methods that will 
more nearly standardize judgments based on such chai'acteristics as 
"feel,” “tension,” and "drag” in the use of precision instruments is 
indicated. 

7. The implication is present that the very nature of the vernier 
micrometer and similar precision measuring instruments is such thot one 
should not expect as high a degree of constancy ns the average operator, 
supervisor, and standards man has been taught to expect. 

Received November S9, 1944‘ 



Movement Analysis as an Industrial Training Method * 
I/awrence 0. Lindohl 

Dtttision oj EilucoJion and Applied PsycJiolojIu, Purdue t/miieriiitu 

Many industrial jobs which involve coordination of hand and foot 
movements in operating machines present difficult training problems. 
Typical of such jobs is contact disc cutting. The company producing 
contact discs experienced considerable difficulty in training new operators 
because the majority did not complete the training and for those who 
did, learning was alow and uncertain. Preliminary investigation with 
experimental apparatus indicated that part of the difficulty encountered 
in training new operative personnel wna due to the failure to identify 
the form of cutting movement necessary for “getting the feel" of satis- 
factory performance of the job. 

The cutoff machine slices thin discs (e.g., .020“ X .150“ diameter 
with d:.002“ on both dimensions) from various sizes of tungsten rods 
with a rubber-bonded abrasive wheel .015 of an inch thick and six inches 
in diameter. The cutting wheel turns between obscly fitted guides, 
moving up and down between the guides and across the rods being cut. 
The pTotesa is wat cuUmg and the whaal is not visible to the opovatoT 
while cutting. Most machines cut two rods at a time. 

The operator pushes the rods through guides into stops which regu- 
late the thickness of the discs. Holding the rods firmly against the stops 
with a hand lever, he operates a pedal with the left foot which controls 
the cutoff wheel as it is applied to the rods. As soon as he cuts through 
the rods he lifts his foot, the wheel rises, and immediately ofter it has 
cleared the stops a backward jerk of the right hand actuates ejector or 
knock-out pins which knock the severed discs into the stream of water, 
Immediately after the ejection of the discs the rods are pushed back into 
the stops and a new cut is taken, Figure 1 shows an operator seated ftt 
a machine ready for operating. 

The cutoff machine depends for successful operation upon the speed, 
form, rhythm,, and pressure pattern of the hand and foot action of the 

* Baaed upon a thesis subiuittcd hy LawtcncQ Guylcrd Ijindahl to the Faculty ot 
Purduo University in partial fulflllinent ot the requirements for the Degreo of Doctor 
of Philosophy, October 1944. Acknowledgment is duo Dr. Joseph Tiffin and Dr. C. S. 
Lawshe who jointly direoted the research and to James R, Brook who mode the study 
possible in mdustry. 
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operator. Failure io apply foot pressure properly results in damage to 
the discs, excessive breakage and use of wheels, and wastage of material, 
The purpose of this study was to analyze the disc cutting operation 
by identifying the form of the foot movement that produced satisfactory 
quantity and quality of discs with minimum cutting wheel usage, and to 
teach this form to new opcrafcoi’sS by the movement analysis method, 



Pia. 1. An operator seated at the disc culolT machine ready for operating, 

The Method 

The A'[)paraius. The mechanical apparatus used for the movement 
nnaly.sis included a paper tape recorder with a specially made writing 
arm attached. A fine thread was fastened to the writing arm and run 
through glass bushings mounted in metal pieces which were clamped at 
accessible places on the cutoff machines, and thence to the pedal iu such 
a manner that the complete cutting cycle movement could be recorded 
on the paper tape as it moved along at a known speed under the pen. 
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The recorder was placed on a -sinall whrtded hilile wliieli was j)u.slied fioixi 
machino to jnachine and checks on o/jcivitor.s u'cn? f/uiclcJy a/u! accomteJy 
made without inter tevcuee with i)r(Kluetiou. 2 is ii schcmsitic 

drawing of the recorder aitiicliod to tlic cutofT niiicldiie. 

Proced 2 ire. Tlie])roccdiiro consisLed firsL of a job iiiuilysi.s by activity. 
The principal activity, the ciitlin;^ cycle, wn.s further analyzed by study*, 
ing the foot action recordings of skilled opendons (,o liini out what cou' 
stituted good pcrfonnanco, T'hc rcconkn* was thou used for iuHlvncUonal 




Fig. 3. Disc cuPer /oot-aoticn paUein of a good, cxpcrionccd o^jcrator, 

This wna the accepted standard, 

purposes in the training of new operators and for improving experienced 
operators already on the line. This typo of analysis is in)i entirely new* 
It was utilized with good results by Tillin and Jlogers (5) in training tin 
plate inspectors and by EngUsh (1) in Ivaining ridemeu. 

The coordination of the foot action in cutting, with the hand action 
in placing the rods against the stops and ejecting the discs after cutting, 
constituted the cutting cycle. The cut t-hroiigli the rod was the cutting 
phase and the ejecting of the discs and placing of the rods against the 
stops was the recovery phase. 
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Since the foot action was the principal part of the cutting cycle, the 
main effort was given to finding the correct foot action pattern and then 
presenting it to the trainees in an effective manner. 

By recording the patterns of experienced operators and super vigors, 
who were also experienced cuttera, and comparing the action patterna 
with quantity, quality records, and abrasive wheel usage records, it was 
possible to identify the ‘‘standard*' or correct pattern. There were wide 
variationa in action patterns of the experienced operators showing the 
exiatence of individual differences, but the consistent pattern was there 



Fig. 4. An enlarged view of disc cutting cycle showing its principal parts. 

to form the basis on which the noted differences could be explained, 
Figure 3 shows the foot action pattern accepted as standard. All aizea 
of rods gave the same pattern, but spacing of cuts was wider for large 
rods because of longer cutting time. The correct pattern showed a good 
reyerse cutting curve which indicated unhurried, steady cutting with 
“feel" of rod. The operator checked his foot at the same place on every 
cut just as he cut through the rod by easing the pressure, thus allowing 
the wheel to cut its way through without making burrs. The short 
follow-through at the bottom indicated, in shop parlance, a “soft" foot. 
The recovery started soon after cutting through, saving time for each cut 
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and allowing plenty of time to coordinate or time the ejection of the disca 
and place the rods back against tlie stops ready for the next cut. The 
operator paced the machine and adjusted his time for the cutting part of 
the cycle to tixe speed at which the wheel could cut best without forcing 
or crowding the wheel. To force or crowd the wheel results in several 
disc defects, short wheel life, and wear out of the setup. Figure 4 ia an 
enlarged view of one cycle showing the significance of cncli part of the 
cycle. Figure 5 is an incorrect pattern made by a trainee with only 
4 hourfl experience. Figure G shows the foot-action patterns of one 
trainee at various stages in the training |)rogram. There is a steady 
approach to the standard pattern and a comj)lotc story is evident in each 
recording after the various lioura of supervised operation. It will be 
noted that the pattern at 239 hours closely resembles the standard pat- 
tern shown in Figure 3, 



Fiq. B, An incorrect disc cutter foot-action pattern. Operator had 
only 4 hours experience. 

Enlarged instructional posters with analytical notations were pre- 
pared both for "eorrect^^ and ^hncorrect'^ patterns and for various types 
of damage to the product which were shown to be reflected in the action 
pattern. Individual action patterns of each operator wore kept in folder 
form also so the operators could note their progress. By careful use of 
the recorder at timely intervals with both the trainees and experienced 
operators and by interpreting the foot action patterns in terms of the 
standard, it was possible to reduce the training time of new operators 
and to improve the quality and quantity performance of some employees 
already on the job. 


Results 

Trainees Versus Old Operators 

Training a group of operators on the production line is not unlike 
breaking in a team of horses, a group of men for a football team, or a 
squad lor the army. All must work together. Especially is this true 
where the operators are working on day rate and a certain amount of 
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production must be obtained each day. One individual cannot do all 
the work no matter how good he ia. The object of the training program 
is, therefore, to get ali of the trainees aa nearly alike aa possible in the 
shortest time and all as good and aa near like the standard as possible. 





Ml NOUf?S 



lha. 6. Disc ciiLLcr foo faction pattcms of a trainee showing improvement with 
Iraimng- The reeonla were made aller Q, 45, 141, and 239 hours of supervised 
operation. 

The Bupevvisor, or trainer, has to move from operator to opemtor, check- 
ing, helping, comparing, encouraging, correcting, explaining, and expect- 
ing progress day by day. If he does not maintain his own interest he 
will not find continued interest in the learners, especially after the 
newness of the job has worn off. He should be interested in tJie group; 
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it ia from the group that he expects to obtain production. It is, there- 
fore, on the group that the training program must be evaluated. Even 
when all possible attention has been given to the group, individual 
differences will remain. Tiffin (6) enumerates many kinds of individual 
differences in job qualifications and individual productivity. The person 
doing the training must constantly detect and give due consideration to 
these individual differences in order to get tlic entire group to the stage 
of perfection ho desires. Equal increments of practice and training do 
not in any sense reduce all trainees to a common level of performance. 
In evaluating the results of a training method on the job where none of 
the variables is controlled, there are factors that prevent one from giving 
too much attention to the production of any one individual. For in- 
stance, there are external limitations on the individuals power to increase 
his output, such as the condition and speed of his machine. One trainee 
may be given credit for less output than another because he was carrying 
an undetected handicap. And even though this handicap ia detected 
tliere is often no way of eliminating it. The speed of two machines that 
look exactly alike may vary tremendously during different periods of the 
day; or supplies of material or the difficulty of the task may set an upper 
limit on individual production which perhaps one-third of the members 
of the group could reach, and no one could better, no matter how com- 
petent he might be. Age is another factor which has unmeasured effects 
on individual production on the line and makes it ncccSxSary to consider 
group differences in evaluating the results of the training program. 

There are numerous ways to evaluate the results of the training once 
it has been put into operation. Lawshe (2) lists 13 methods and from 
such an extensive list one should find a method that fits any particular 
case. 

In machine operations, like disc cutting, jobs have been time-studied, 
rates based on these studies have been set, and production of trainees 
and old workers alike is indicated by the output. In the particular 
operation reported herein training can be evaluated on two factors, 
namely production performance and wheel performance. Both wheel 
breakage and wheel use are important aspects of wheel performance. 
The two factors are considered to be of equal importance and manage- 
ment has set up a rate sheet based on the number of cuts secured per 
wheel for a given size of rod and the speed of cutting (production per 
hour). In other words, tlio operator must get a specified number of cuts 
per wheel and must cut at such a speed that he will turn out enough units 
in one hour to earn the base rate set per hour. "When he gets the exact 
number of cuts per wheel for the rod size he is cutting and cuts just 
enough to earn his hourly rate, he is doing 100% performance in both 
factors, namely, production performance and wheel performance. 
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There are geyeral reasons for emphasizing wheel performance. One 
is that the special type of wheel used for tungsten disc cutting is very 
expensive and wheel costs can very easily exceed labor costs. Also, a 
better quality of product is obtained by limiting the speed of cutting, 
which is effectively done by placing emphasis on wheel performance. 

Curves arc used to evaluate the effects of this training program. As 
stated by TilTin (6, 186), "such curves, therefore, serve the very useful 
purpose of providing a means of evaluating the successfulness of an 
operator^training irrogram and spotting decisively those operations in 
which training is inadequate, either in quantity or quality.” 

Figure 7 is the production curve of the trainees for 12 weeks. Pro- 
duction performance percentage is plotted on the vertical axis and weeks 
(0 days each) of training on the horizontal axis. Production perform- 



Fig. 7. Production performance percentage of diac cutter trainees. Dotted linea 
represent average production pcrfornianco percentage for first 2 weeks of groups with 
an average of 2, 6, and 9 months experience at start of training. 

ance percentage inakea the production performance of all operators 
comparable since it ia computed on the company rate ah^et for the various 
sized rods cut. For instance, if an operator using 6^^ wheels to cut .142 
inch rods, cuts 12,000 units of rod in 10 hours, he cuts at the rate of 
1,200 units per hour. The rate sheet indicates the operator should cut 
2,340 units per hour to earn the base rate of 65 cents per hour. Since 
1,200 is 51 per cent of 2,340, his production performance is 51 per cent. 
The production performance percentage is, therefore, the average num- 
ber of units cut per hour divided by the number of units that the operator 
is expected to cut per hour of the size rod being cut to earn his wage. 

The dotted lines in Figure 7 show the production performance of old 
operators at the start of the training experiment. There are three groups 
of these old operators. Before the training started, eight operators had 
an average of 2 months, nine operators had an average of 5 months, and 
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ten operators 9 months expeiience oH tlio job, Tho trainees hnd no 
previous experience. Old opera tors total 27 and trainees 19. No data 
^vere available on the production abilities of the various groups prior to 
the start of training. In order to obtain a basis of comparison for the 
groups, an average of the production of fclio first two weeks at the begin- 
ning of the training is considered indicative of the ability of the groups 
of old operators at thot time. These averages arc sliown on tlie figure 
by the dotted lines. 

The production curve for the trainees reflects a steady rise. At the 
end of 8 weeks they have surpassed the average of the 2 months group. 
At 11 weeks they exceeded what the 5 months group was able to do at 
the begmiiing of the taainmg program. Although their average fell on 
the 12th week, this is not unusual in curves of this type. The general 
trend ia upward and with more confidence, experience, and continued 
training it should be safe to assume that' the curve should reach the top 
limit of the 9 months group in much Icag time than 0 months, resulting 
in saving many man hours of training time. 

One may legitimately inquire about the quality of the discs cut. 
There was no difference in the quality of the discs cut by the trainees 
and by the other groups. The company used a production checker who 
continually checked the discs os they were cut by going from operator 
to operator and it was practically impossible for any one operator to cut 
a majority of the defective discs. Tho machine would ho shut down or 
the operator's performance investigated to determine the cauBo of the 
defects. Any shut down would be reflected in the production perform- 
ance of the particular operator, Since tungsten is an expensive material, 
it was imperative to keep wastage at the very minimum. One hundred 
per cent inspection of the discs was made after a tumbling operation! but 
this was done according to size of discs and the production of two or three 
operators cutting the same size rods was usually thrown together. Pro- 
duction control regulated the quantity to be cut over any one period. 
In the form of stricter supervision this control probably served aa a 
forced incentive to the worker. 

Figure 8 ia the wheel performance percentage plotted against weeks 
of training. Tho averages of the 2^ 6, and 9 months groups of old oper- 
ators in wheel performance are shown by tho dotted lines. These aver- 
ages are of the first two weeks petfoimancQ at the beginning of the 
program. Wheel performance percentage is computed from the rate 
sheet, Ileferring to the illustration previously cited, if the operator who 
cut 12,000 discs in 10 hours used, without breaking, 20 of the 5" wheels 
and broke 5 others, he used a total of 25 wheels to cut 12,000 discs. He 
obtained 480 units per wheel. According to the rate sheet, 100 per cent 
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wheel performance on .142 rod requires 470 units per wheel. The wheel 
performance is 480 divided by 470 or 104 per cent. Wheel performance 
is, therefore, the units the operator gets from each wheel divided by the 
number he should obtain according to the rate sheet for the size of rod 
being cut. Wheels broken must be counted as wheels used, for the 
ojrerator gets some cuts with the wheels before they are broken, Wheel 
performance is negatively correlated with production performance. The 
faster the cutting the higher the production and the fewer units per wheel. 
This relationship had to be regulated in the training program and empha- 
sis placed on cutting according to the cutting curve so that both maximum 
wheel performance and maximum production were obtained. 

The rate sheet is made up on the basis of 100 per cent production 
performance and 100 per cent wheel performance. Figure 8 shows the 
9 months operators at exactly 100 per cent wheel performance while 



Fia. 8. Wheel performance percentage of disc cutter traineea. Dotted lines repre- 
sent average ^Yhcel performance percentage for first 2 weeks of groups with an average 
of 2j 5, and 0 months expcricnco at start of training, 

Figure 7 shows their production performance at 81 per cent. It will be 
observed by reference to Figures 7 and 8 that the trainee curve goes up 
toward 100 per cent production performance and downward toward 100 
per cent wheel performance. 

One must speculate on the sudden upturn in the wheel performance 
curve of the trainees after the 9th week. It can be accounted for to 
some extent at least by the fact that a more rigid accounting of wheels 
used was started at that time. Some operators had acquired the habit 
of not using all the wheel because of the slower cutting pace due to the 
smaller diameter of the wheel as it wore down. These operators changed 
wheels before entirely using them. This lowered the wheel performance 
and tooJc more wheel?. By requiring operators to turn in every used 
wheel for inspection at the end of the day^s run it was possible to deter- 
mine just wliich operators had not entirely used their Avheela. The gen- 
eral effect was that all operators tended to use up their wheels, thus 
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getting higher wheel performance. This might also cause the slightly 
lower production because of slower cutting as the wheel grew smaller. 

The best operator would get as much over 100 per cent wheel per- 
formance and as much over 100 per cent production performance as 
possible. To do this he would have to cut steadily, consistently^ and 
carefully during all working time. Failing to do this he could not pos- 
sibly get over 100 per cent wheel performance even though he might cut 
fast to make up lost production time, because the faster he would cut the 
lower his wheel performance would become. The interrelationship of 
wheel performance to production performance complicated the training 
problem and made the movement analysis method all the more important. 



Via. 9. Pcrcenfcago of wheels broken by disc cutter trainccB. Dotted lines repre- 
sent average percentage of wheels broken for first 2 weeks by groups with an average 
of 2| 5, and 9 months experience at start of training. 

As has been noted, this found a standard pattern that laid stress on both 
accuracy and wheel performance. 

Figure 9 shows the percentage of wheels broken plotted against weeks 
of time. Percentage of wheels broken is the fraction of the total number 
of wheels used each week. For instance, the number of wheels used 
'without breaking plus the number broken is the total number used. The 
ratio of the number broken to this total is the percentage broken. If, 
for example, an operator wore out 300 wheels in one week and broke an 
additional 25, he used a total of 325 wheels. The percentage of wheels 
broken during the week is 26 divided by 325, or 7.7, 

Figure 9 shows graphically the trainees' reduction in wheel breakage 
due to the attention given to the correct cutting method. During the 
first week the trainees broke 24 per cent of their wheels. By the third 
week they were breaking leas than operators having 2 months experience, 
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by the 5th week less than those having 5 months experience, and by the 
10th week leas than those having 9 months experience. By the 12th 
week of training the trainees broke only 1.8 per cent of their wheels, or 
about one-third that of the group with 9 months previous experience. 
This is good for two reasons; first, because the wheels were very expensive 
and large savings reaiiltecl (wheel coat could very easily exceed labor 
coat), and second, all time taken to change broken wheels has to be 
charged against production time. Broken wheels prevent running for a 
period ranging from one minute to sometimes as long as a half hour, 
depending on how long it takes to remove the broken pieces from between 
the guides* 

The higher average wheel performance noted for the trainees is due 
to emphasis being placed on accuracy rather than speed and on correct 
operation, or cutting according to the reverse cutting curve. High wheel 
performance eventually leads to increased production. It insures a 
better quality of product at the beginning with less wastage. The curve 
shows that the trainees steadily reduced their wheel breakage. In Fig- 
ures 7, 8, and 9 the trainees show exceptionally fine performance in rela- 
tionship to the other three groups of operators who learned by the 
'^pick-up method. Although their production average was lower than 
the 9 montlis group of operators, they steadily increased production, 
their wheel performance was maintained well over 100 per cent, and the 
per cent of wheels broken was considerably reduced. 

Trainees Versus Beginners 

Another way operators learn jobs, probably more prevalent than any 
other learning method in industry, is that of '%rial and success, This 
consists of showing the operator his job and then '^turning him loose” 
to learn in the beat way he can. It is a sort of *'sink or swim” propo- 
sition, The operator is not led from the beginning by progressive steps 
and has no reliable indication of his progress. Such haphazard learning 
usually results in lower efficiency and poor work habits, 

It was possible to obtain records over a period of three weeks of the 
production and the wheel performance of 5 operators who were learning 
the disc cutting operation in just this manner. They are called begin- 
ners for purposes of comparison with the trainees who were trained by 
an organized mothod. These beginners did not have the advantage of 
using the movement analysis recorder nor any of the instructional 
material. 

Figures 10, 11, and 12 present a comparison of the production per- 
formance, wheel performance, and wheel breakage of beginners and 
trainees at the end of the first, second, and third week of operation on the 
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job. Ftgurea 10 and 12 do not show a aignificant difFcreiicc between the 
two groups in production performance and percentage of wlicels broken. 
Figure 11, however, shows giiiphicnlly considerable difference in wheel 
performance percentage between the two groups. Whether the differ- 
ence shown can be attributed to chance can be tested statistically by 
finding (1) the significance ratio for the difference in the means of two 



Fig, 10. Production perform an c& percentage of diac cutter traincca and 
beginners for first three wcelm. 



Fiq. 11. Wliccl performance percentage of diac cutter trainees and 
beginners for first three weeks. 

independent small random samples. The smallest difference between 
the two curves occurred at the second week. The significauce of this 
difference, therefore, was computed to determine the possible role of 
chance in accounting for the difference between the curves. The second 
week of training or experience shows a wheel performance percentage 
mean of 129 for the trainees and 86 for the beginners. Substitution in 
the formula (3) for finding the significance ratio for the difference in the 
means of two independent small random samples results in a ^7” of 2.548. 
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Eeference to the table of f’s indicates a “t" of 2.518 for 21 degrees of 
freedom is required for the 2 per cent confidence level, The obtained 
difference is therefore significant at the 2 per cent level -yrhich means 
that there aic 98 chances in 100 that the difference found is not due to 
chance and must therefore be due to the special training given the experi- 
mental group. 


Effect of Training Program on Old Operators 
When any training is carried out directly on the production line it is 
bound to have somo effect on the experienced operators even though 
most of the attention is directed to the trainees. Studies have been 
made of factory workers in which work conditions of all kinds were 
varied. A noteworthy example is the experiment carried out in the 
Hawthorne plant of the Western Electric Company (4). Its moat impor- 



Fia. 12. Porconfcftge of wheels lirokon by disc cutter trainees and 
beginnora for first three weeks. 

taut finding wna that regardless of the nature of the changes made in 
the working conditions the productivity of the experimental group tended 
in general to increase. Although the interest and attention undoubtedly 
had a stimulating effect on the old operators, the fact that foot-action 
iccordings and interpretations were made for them as well as the trainees 
would lead one to believe that interest and attention did not account for 
the total improYoment, 

One cannot rush up to an old operator with a new gadget with the 
expressed purpose of checking up on him. The cooperation of the old 
operator may be secured, however, by explaining to him the need for 
finding out how the job is done so that it can be taught to the new oper- 
ators. Practically every old operator will give the best performance he 
can muster up and is then already on the road to self improvement. One 
can also question the operator about hia work. As soon as the old 
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operator finds that someone is interested in his job he begins to think 
that the job is important after all and he is likely to take more interest 
in hia work and that of fellow workers. Learning becomes contagious, 
production starts to increase, the entire line improves, and no one but 
the person in charge of the training is aware of it or knows the reason why. 

If those operators who seem not to want help are ignored for a while 
they will soon seek help either by asking for a recording or by letting it 
be known that their recordings have not been taken. Workers all desire 
to be treated alike. 

A review of the foot-action patterns ^ shows that old operators used 
a lot of waste motion in cutting and most of them had not developed the 



Fig. 13, Percentage of improvement or loea in wheel performance, production per- 
formance, and wheel hrealiago reduction for groupa having an average of 2, 6, and 9 
monthfl experience on the disc cutoff machine prior to the start of the training program. 

necessary That they could improve by watching the recorder 

was also shown. 

Figure 13 shows the percentage of improvement or loss in wheel 
performance, production performance, and wheel breakage reduction 
made during training by groups having an average of 2, 5, and 9 months 
of experience on the disc cutoff machine prior to the start of the program. 
The graph is based on averages for the first three weeks and the hist 
three weeks of the training period. In computing the percentage of 
improvement or loss, the performanee at the start of the program was 
considered 100 per cent. 

All three of the groups broke fewer wheels after the training was under 
way. The 6 months group made the greatcat improvement by breaking 
69 per cent fewer wheels than they did at the start, the 9 months group 

* Coao studies and complete presentation of data will be found in tlie appendix of a 
thoflis by the author on file in the library of Purdue Univorsity. 
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40 per cent Icsa, and the 2 months group 32 per cent less. Reduction in 
wheel breakage cfEcctcd n substantial saving in wheel costs over the 
period. 

The 5 months group improved their production performaucef 21 per 
cent but BufTcred a km of li per cent in wheel performance. Since 
produetion performance is negatively correlated with wheel performance 
and both are of ecpinl importance, ihh represents total improvement and 
reflects the emphasis placed on wheel performance by the movement 
analysis method. Likewise the 2 and 9 months groups improved their 
wheel performance by 28 and 6 per cent, respectively, at the expense of 
production by only 6 and 5 per cent. Again with wheel performance 
and production performance of equal importance this represents sub- 
stantial improvement- 

The total picture ia good when one considers the nature of the opera- 
tion, that it is a hand and foot coordinated operation which requires the 
human operator to function with mechanical precision over long periods 
of time, and tlmt old operators may have learned as many bad habits os 
good, necessitating unlearning before starting new habits. 

That these experienced operators could so effectively cut down in the 
number of wheels broken and improve in both wheel and production 
performance at this stage of experience indicates that learning of a better 
cutting cycle by old, experienced operators took place with the installa- 
tion of the program for training new operators. The improvement made 
by the ex])oriGnccd operators aa well as the trainees seems to justify 
movement analysis as an effective industrial training method. 

Summary and Conclusions 

The problem of training rapidly a number of new workers to operate 
certain type of cutoff machines used for cutting tungsten rods into small 
discs for electrical apparatus has been explained. A method has been 
described which analyzes the foot movement of the operator by the 
recording of a pattern on a moving paper tape. A standard pattern was 
established and the recorder was used to take recordings of the trainees 
at frequent intervals. These recordings were explained on the basis of 
the standard. Various defects in the product were identified with the 
foot movement patterns and many individual differences in both old and 
new operators were noted and described os clinical case studies. Finally, 
complete production records of alt operators were kept. These records 
were plotted in graphical form to show the progress of the various groups 
at different stages of training. 

In general, the findings warrant the following conelusions: 

1. The disc cutting operation was analyzed by activity and the best 
form of cutting movement identified. 
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2. The cutting movement of the operators was shown in graphic 
form, compared with a standard, and used ns an effective training method. 

3. Training time was effectively reduced. At 8 weeks the produc- 
tion performance percentage of the trainees was better than that of old 
operators who had had the same average amount of experience by the 
"pick-up" method, 

4. Trainees, who were taught to use the cutting wheel by studying 
the movement analysis recording.?, secured hotter wheel performance than 
old operators. 

5. Trainees reduced their wheel breakage in a few weeks to a point 
much lower than the average of old operators at start of training program. 

6. Trainees did better in wheel performance tlian beginners who 
learned by the "pick-up" method. 

7. Experienced operators benefited by the training program. 

8. It is entirely possible that equally successful improvements in 
training could be made in numerous other manipulative jobs by the 
application of a similar method of recording graphically the performance 
of the operator. 

Received November 1, 19^. 
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Military Job Evaluation i Army Air Forces * 

Arthur 0. England,** Captain, Air Corps 

During tlic early Btngcs of 1942 and 1943, when the reception centers 
were bulging with incoming men, the paramount problems facing the 
classification and personnel oflicers wore the initial classifying of these 
men, fulfilling the technical achool quotas and inaugurating on-the-job 
training necessary to build efficiently operating tactical units. Little or 
no information was available on the subject of effective utiliaation of 
manpower. Job evaluation, by any method, was non-existent— or if 
existent, at least it was not available for general consumption by military 
personnel. 

A War Department Memorandum ‘ issued in January 1943 stated in 
part that many enlisted men in the Army Air Forces who have been 
trained as technicians in the various Army Air Forces Technical Schools, 
were being employed on jobs which did not require special training or 
special (lualifications and which were appropriate for unskilled privates 
only. The Inspector General’s Department assumed some of the re- 
sponsibility for detecting and reporting to the War Department personnel 
misplacement and attendant wastage. Further, every Air Force or 
Command o.stabJished a special unit known as Classification Audit Teams, 
whose function it is to inspect periodically each installation in that Com- 
mand for proper classification, assignment and personnel utilization. 
Tliese teams are composed of officers who possess extensive experience in 
Military Classification and Assignment. 

In an effort to control the reclassification * of these highly trained 
technicians. Headquarters, Army Air Forces, issued a Memorandum ’ 

* This Itcsonrcli Project was conductod during 1043 under the general supervision ot 
Col. Alvin L, Prichard, Asst. Cliicf of Staff, A-1, Amy Air Forces Eastern Plying 
Training Comniand. 

** Cnpt. Arthur 0. England is Oflioor in charge of Classification Research Section, 
Army Air Forces Eoatern Flying Training Command. 

‘ War Department Memorandum No. WC16-9-43, Adjutonl Generol'a Department, 
January 22, 1043. 

’ Rcclaaslfication ia a term used to dcaoribo any chango in the classification of the 
incumbont. 1 1 may bo downward (representing less utilization of the individual a oapa- 
bilitics), upward (representing greater utilization of the individual's capabilities) or 
lateral (representing less utilisation of the individual’s copabilities, but in a different 
field of skill). Insofar ns we ore concerned iu this article, fcclassiiicalion will be con- 
strued to mean downward reclassification. 

* Army Air Forces Memorandum No. 35-10, January 22, 1943. 
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malting all reclaBsification subject to approval of n specially appointed 
Board of Officers (one of whom must be a Classification and Assignment 
Officer), at every Air Forces Air Field or similinr installation. Evidence 
must be established during the board meetings to the effect that the 
proposed reclassification of an incumbent will be of benefit to the Army 
Air Forces. Such reasons as: physically incapable of performing duties 
of the old job, proved inefficiency by actual on-the-job trial, or the in- 
cumbent^s qualificatlona arc needed to perform in a more critictLlly 
needed job specialty, would justify reclassification. 

Although this established control medium has, to a large extent, pre- 
vented wholesale malassignmenl and inefficient personnel utilization, the 
evaluation of each individual case appearing before the Claasification 
Board was dependent ultimately upon the local, subjective interpreta- 
tions of the values of the military jobs by the Board, 

Job specifications of Military Occupational Specialties are, by neces- 
sity, designed for flexible interpretations to provide a method whereby 
an individual, performing duties on various types of equipment, peculiar to 
each Air Force or Command, can qualify as a epccialiat in this one general 
job. For example, there is one set of job specifications for Airplane 
Mechanic. However, the Airplane Mechanic who lias been trained on a 
four-engine Flying Fortress is definitely a higher skilled mechanic and 
can perform a greater variety of mechanical duties than can a mechanic 
who has been trained on a single engine Primary Trainer Airplane. 
Both, however, receive the aame rating of Airplane Engine Mechanic. 

It was because of the above instances of a laclt of any standardized 
method of evaluating Army jobs, along with the relatively high degree of 
subjective interpretations that has been entering into the problem of re- 
classification and personnel utilization, that the publication “Job Evalu- 
ation for Army Military Occupational Specialties, “ ^ appeared December 
18, 1943. The problem at hand was to provide a means of establishing 
standardized values for different Army jobs for the purpose of ascertaining 
efficient utilization of available manpower.® 

Procedure: A Factor Analysis 

An attempt was made to identify all of the possible factors for a job 
analysis. Nine significant items were finally selected and retained in the 
rating scale. Each item is divided into six component parts, with a nu- 
merical value assigned to each. The numerical value of each item de- 

‘ Job Evaluation for Army Military Occupational Special tica, developed by Capt. 
A. O. England, HeadquarlcTa, AAE Enalorn Plying Training Command, Cl aapift cation 
HcBcarch Saction, Maxwell Field, Alabama. 

“ It should be noted here that the publication of "Job Evaluation for Army Military 
Occupational SpcciaUieB" waa intended to boivg solely as a "guide" and does not repre- 
soat an odicial publication by the War Department, 



Table 1 

Factor WysiB and Point Values on Job Bating Scale 
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ponds upon ita relative position in the table (Table 1), i.c., tlie level of 
difficultyj or the higher tlie requirements, the higher the point value 
assigned to each item. Tlie point value range extends from 0 points to 
a maximum of 5 points. Tills range was arbitrarily agreed upon. It 
could have been 0 to 50, or 10 to 100, or any progression of numbers. 

In the selection of differentiating items, one very significant item had 
to be discarded, namely wage scale. Unlike most civilian rating scales, 
pertaining to the job, wliicli are uaiially weighted heavily, the Army docs 
not adhere* to any specific wage scale for military jobs. That is to say, 
a soldier^s grade (Private, Sergeant, etc.) does not necessarily prohibit 
him from performing any military job. Because of a multitude of factors 
influencing the promotion of enlisted men, it has been impossible to cor- 
relate any job to a particular grade. There are numerous instances of 
Sergeants working for Corporals because the Corporals arc more quali- 
fied by reason of proven experience on certain type aircraft than otlier 
soldiers of higher grade. 

Items to be Rated 

a. Educational Requirement: The range extends from none to Post 
Graduate. Even though exact information on educational requirementa 
is obscure for any military specialty, the majority of specialties have 
some minimum requirement, cither clearly established in AAF Regula- 
tion 50-12 or arrived at by a consensus among tliosc individuals exercising 
supervisory juriadiGtion, even the particular military epecialticvS. Point 
values assigned to the educational levels are indicated in Tabic 1. 

&. Civilian Ex-pmence: There are a tew selected jobs in the Army that 
require civilian experience of varying degrees. Factors influencing the 
awarding of point values to this item are the existence or absence of 
similar training in the Army. Tabulating maciiino operators, office 
machine servicemen, and psychological assistants arc examples of military 
specialties that require a civilian background in that specialty before as- 
signment to the specialty ia made. Point values are assigned according 
to the time spent gaining experience in that specialty in civilian life. 

c. Training Time on the Job: A consenaua among competent personnel 
was used to assign point values for the ^^average^^ time spent becoming 
skilled in the specialty. 

d. Intellectual Requiremejitf — By Minimum AGCT Score: ® Once 
again, in those instances where the AGCT Score requirements are not 
clearly prescribed by regulations, such as the AGCT requirements for 
attendance at Technical Schools, a consensus among competent personnel 
was obtained. Point values assigned to this item are broken down ac- 
cording to the five groupings of AGCT Scores. 

^ AGCT: Array Gancral OlasaificaUon Tcjst. 
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e. Skill: This iGpresents a combinfttiou of aptitude and acquired 
talent. Perhaps this is one of the weaker items in this factor analysis 
because of the difficulty involved in rating the "skill’^ employed in each 
military specialty. A point of issue may very justly be taken on the line 
of demarcation between '^passable” and "fair'" skill. The extremities of 
this range are relatively clear; Kitchen Police/ requiring skill, and 

IBM Machine Repairman, requiring “superior^' skill, are cited os ex- 
amples of the extremes of the point value range. It was only after con- 
stant comparison of all factors involved in the performance of each job 
that the ensuing ratings in the item were arrived at. 

/. Supervisory Capacity —Number of Men Supervised: The point 
values assigned to this item are not dependent upon the number of men 
one has jurisdiction over, but rather the number of men one directly 
supervises and is responsible for in the exact performance of his job. 

g. Nature of Work: The range of this item is from "routine” to ”su- 
perior employment of ingenuity.^' Here, creativeness, originality and 
independent responsibility are evaluated, 

A. Equipment Used on the Job: No particular difficulty was encoun- 
tered in placing the proper point values to the breakdown of the scale in 
this item. The range extends from none to very intricate. 

The difficulty of all rating scales lies in the proportionate point value 
assigned to each component part of each item. Which items shall be 
weighted the most, which the least, will depend upon a general consensus 
among those people who are cognizant of the job requirements being 
considered. That does not necessarily represent an inherent weakness in 
Rating Scale theory, but rather a weakness in our knowledge of the re- 
quirements of Army jobs. 

Factor Analysis of Military Specialties Authorized 
for Use in the Army Air Forces 

In this section, a factor analysis of Military Occupational Specialties 
has been performed by items on the basis of Family Groupings of jobs. 
The total points awarded each Military Specialty have been rated by the 
rank difference method. The relative rated position each specialty holds 
to each other is indicated in the column entitled "Final Rated Poaitione,” 
The jobs have been arranged in a aeries, with the range extending from 
the highest evaluated job to the lowest evaluated job. 

Not only is the ^ 'Final Rated Position” important in the evaluation of 
B job, but also the actual total point difference between the evaluated 
jobs should be given consideration. This becomes at once apparent 
when comparisons are made among Military Specialties on Single, Twin 
and Four Engine Airplanes, and when interchange of jobs among different 
Family Groups is attempted. 



Table 2 

Job EvalimtIoiL Ratings of a Sample of Five Military Job Groups 
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In this article, only five Military Job Groups have l)een presented. 
Actually, all the existing pertinent Army Air Force jobs have been evalu- 
ated in their respective Family Groups. In addition to the distinct 
Family groupings of jobs, one other Group, known as the '^Miscellaneous 
Group,’* was brought into ])lay. This Group represents u hetcrogeneouB 
grouping of military jobs. Actually, many different family groups are 
represented and because they are, it was impossil^Ie to differentiate them 
by the factor analysis method. Examples of jobs falling into this 
grouping are Bricklayer, Laundry Technician, Translator, Bandsman, 
Log Trainer, etc. Interchange of duties within this miscellaneous 
group will be dependent upon the discretion of the Classification Board 
after a careful study has been accomplished on the proposed transfer. 

Index for Evaluated Military Occupational Speoialbiea 

The evaluated jobs were prepared in a readily accessible list. This 
listing, by family groups, shows the different jobs by their degree of 
“over-alF* difficulty. Reference may be made to the index of evaluated 
jobs under the following circumstances: 

(1) To ascertain if one job is upgraded or downgraded relative to 
another in the same family group. 

(2) To ascertain the correctness, from a classification standpoint, of 
proposed new duty assignments in relation to tho present duty assign- 
ment. 

(3) To ascertain the validity of reclassifying an enlisted man from one 
Military Occupational Specialty to another. 

(4) To reallocate enlisted men efficiently within a Command. 

The interchange of jobs from one family group to nnotlier has always 
presented a challenging problem to tlic Classification and Assignment 
Officers. However, until such time as an evaluating scale has been de- 
vised whereby family grouping jobs may be compared, it appears highly 
improbable that a valid comparison can be made between the total 
awarded points of a specialty in one family group to the total awarded 
points of a specialty in another Family group. A specialty requiring a 
high degree of mechanical skill, thus being rated highly in the evaluated 
job scale, cannot be compared adequately, say to a particular clerical 
job requiring a high degree of creativeness. 

Preparation of a Reallocation Adjustment Table 

An attempt has been made to prepare a reallocation adjustment table 
to be used as a guide in the reallocation of enlisted men by the qualifico^ 
tions in a particular Military Occupational Specialty, between single, 
twin and four engine flying schoola. 

The Personnel Divisions of any Air Force headquarters have from 



445 


Military J oh Evaluation: Army Air Forces 

Table 3 


Inde^: for Evaluated Military Occupational Specialties: Final Liating of Rated 
Jobs by Level of their DilTiculty 


SSN 

Job Title 

Total 

Points 

Final Rated 
Position 

274 

Administrative and Clerical Group 

Public Relations Specialist 26 

1 

602 

Administrative Specialist 

22 

2 

276 

Clnsflificfttion Specialist 

10 

3.5 

823 

Financial Typist-Clerk 

10 

3.5 

213 

Stenographer 

18 

6 

405 

Clork-Typiab 

15 

6 

820 

AAP Supply Technician 

14 

7 

821 

QM Supply Technician 

18 

8 

056 

Clerk, Non-Typist 

11 

9 

348 

Parts Clerk, Automotive , 

10 

10 

836 

Supply Clerk 

9 

11 

067 

Message Center Clerk 

8 

12 

050 

Postal Clerk 

7 

13 

BBS 

Armament and Ordnance Group 
Bombsight Mechanic 

29 

1 

678 

Power Turret and Gunsight Mechanic 

23 

2 

612 

Airplane Armorer-Gunner 

19 

3 

911 

Airplane Armorer 

17 

4 

611 

Armorer 

12 

5 

001 

Munitions Worker 

5 

6 

870 

Chemical Group 
Chemical Technician 

27 

1 

800 

Decontamination Equipment Operator 

17 

2 

786 

Toxic Gas Handler 

13 

3 

760 

Airplane Maintenance Group 
Airplane Maintenance Technician 

32 

1 

748 

Airplane Mechanic-Gunner 

23 

2 

085 

Airplane Electrical Mechanic 

21 

3,6 

680 

Airplane Instrument Mechanic 

21 

3.5 

684 

Airplane Power Plant Mechanic 

20 

6 

687 

Airplane Propeller Mechanic 

19 

6.5 

114 

Machinist 

19 

6,6 

ms 

Fuel Cell Repairman 

18 

8 

628 

Airplane Hydraulic Mechanic 

17 

9 

747 

Airplane and Engine Mechanic 

16 

10 

656 

Airplane Sheet Metal Worker 

14 

11.6 

669 

Glider Mechanic 

14 

11.5 

650 

Airplane Woodworker 

12 

13 

548 

Fabric and Dope Mechanic 

10 

14 

689 

Airplane Cable Mechanic 

8 

16,5 

256 

Welder, Combination 

8 

16.6 

014 

Transportation Group 

Auto Equipment Mechanic 

13 

3 

932 

Special Vcliicle Operator 

8 

2 

931 

Heavy Auto Equipment Operator 

7 

3 

346 

Auto Bquipmont Operator 

6 

4 
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time to time experienced difiiculty in the reallocation of liighly trained 
military apecialists, especially when this reallocation necessitated the 
involvement of perfionnel at single, twin and four engine flying schools. 
It has "been far too great a task to exjicet IleadcpiartarH Assignment 
Officers to analyze each enlisted man^s Qualifications to ascertain the 
type of equipment on which the individual has had training, thus earning 
a skilled or semi-skilled riiting in a Military Occupational Specialty. 

Such problems ns "can an Airplane Maintenance Technician, experi- 
enced only on single engine, Basic Training planes, be adcciiiatoly em- 
ployed as an Airplane Maintenance Tecliiiician on four engine Mying 
Fortresses" are confronted daily by Personnel sections. Yet, objective 
answers to such problems are not to be found in existing Army directives. 
Further, the Engineering Oflicera at different airfields have been faced 
also with this perplexing problem, namely, that enlisted men qualified as 
Airplane Maintenance Technicians on Basic Training planes, were as- 
signed to them for work as Airplane Maintenance Technicians, yet the 
airfield only has tour engine planes stationed there. In the interest of 
good military classification, tliesc enlisted men have earned their clas.gifica- 
tion as Airplane Maintenance Technicians and should not be deprived of 
it. Yet in the interest of efficient engineering operations, the men are not 
qualified to perform the duties of a Maintenance Technician on, let\5 say, 
Liberator Bombers, B-24 planes. Personnel shortages at different airfields 
are rated only by the general Military Occupational Specialties without 
any specific reference to the typo of equipment or airplane on which the 
men have had experience. Further, personnel are reallocated from airfield 
to airfield simply by mass numbers, disregarding, because of necessity, 
experience levels or types of experience of the individual man involved. 

In order to overcome some of the personnel reallocation problems out- 
lined above, it was decided that a comparison of indices for evaluated 
military specialties relative to single, twin and four engine airplanes be 
conducted. To compare adequately the total evaluated points assigned 
to each military specialty at single, twin and four engine flying schools, a 
job analysis was conducted, at representative stations of each of the 
aforementioned flying schools. Only tho.so Airplane Maintenance Mili- 
tary Specialties performed at all three types of flying echo ala were sub- 
jected to the factor analysis breakdown. Comparative figures among 
the different types of single engine planes, as well as among the twin and 
four engine plaues, proved to be insignificant. Therefore, the realloca- 
tion adjustment table (Table 4) has only three main groupings — single, 
twin and four engine. 

Reasrgnment of surplus specialists or the reassignment of malaggigned 
specialists, for corrective measures, between different types of flying 
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achoola may be made efficiently if the relative evaluated job mtinga at the 
different type of achoola are made accessible to those in control of reas- 
signment. For example, should an airplane Crew Chief on a Basic 
Training aircraft be sent to a four engine flying school if no vacancies 

Table 4 


Reallocation Adjustmont Tabic 



Single Engine 


Twin Engine 


Four Engine 



Suffix: r 


Suffix II 


Suffix IV 


SSN 

Job Title 

SSN 

Job Title 

SSN 

Job Title 

J oral 
Points 





750 

AP Maint. Tech. 

32 



760 

AP Maint. Tech. 



31 







32 







29 







28 

760 

AP Maint. Tech, 





27 







26 







26 







24 







23 







22 



086 

AP Elec. Mech. 

686 

AP Inet. Mcch. 

21 





666 

AP Elec. Mcch, 

21 



680 

AP Inat. Mech- 



20 

686 

AP Inst. Mech. 

697 

AP Prop. Mecli. 

687 

APProp. Mech. 

19 

687 

AP Prop. Mech, 





18 

685 

AP Elec, Mech, 





IS 



628 

AP Hydraulic Mcch. 

628 

AP Hydraulic Mech . 

17 

628 

AP Hydraulio Mech. 



747 

AP and Eng. Mech, 

16 



747 

AP and Eng. Mech. 



16 

747 

AP and Eng, Mech. 

555 

AP Sheet Metal 


AP Sheet Metal 

14 




Wkr. 


Wkr. 


666 

AP Sheet Metal 





14 


Wkr. 







exist at any other single engine schools? Reference to the RGallecation 
Adjustment Table presents the following picture: 

a. Airplane Maint. Technician at a Single Engine School has been 
awarded 27 rated points. 

b. Airplane Maint. Technician at a Four Engine School has been 
awarded 32 rated points. 

From the standpoint of effective placement of personnel, a plus or 
minus (zt) two (2) evaluated points is considered a reasonable difference 
to overcome, without losing too much training time, in the adjustment of 
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a specialiat to a difforcnt type of job training. I'lie acljustiiicnt ]jTobletii 
involved lierc become!?, nt once, aiipareiit, Thia Airplane Maintenance 
Mechanic on the Single Engine piano would find it almost impossible to 
overcome the five (5) points difference were he to be placed on duty as an 
Airplane Maintenance Technician on a Pour Engine plane. Thins, if he 
were transferred to a Four Engine Flying School, he would have to atart 
in the lower category job, Airplane and Engine Mechanic (747). 

Thus, it is apparent that reference must be made to the type of equip- 
ment upon Avhich the enlisted man has won his rating ns a Military 
Specialist and how the ])oint value of that specialty at each type of Plying 
School compares before correct am! efficient reallocation of military 
apeoialista can be effected. 


Summary 

In summarizing, the salient features of this job study have been: 

1. The preparation of a standardized method to interpret the relative 
level of difTiculty of different military jobs. 

2. The preparation of point rating scale, with assigned values to each 
job, which is based upon nine significant job featuroa, This helps reduce 
the subjective interpretation placed upon broad, goacraVizcd job specifica- 
tions contained in the army publications. 

3. The preparation of a reallocation table, applying the principles of 
factor analysis, to assist those military personnel people in the task of 
reallocating their overagea and shortages of personnel most efficiently. 

4. Mthough this job study was only utilized extensively in the Army 
Air Forces Eastern Flying Training Command, Ilcadquartcrs, Army Air 
Forces, requested that distribution of "Job Evaluation for Army Military 
Occupational Specialties” be made for all Air Forces and Commands 
within the continental limits of the United States for their inspection and 
critioism. Reports received from these other Air Forces and Commands 
were most favorable and the general validity of the devised rating scale 
was not challenged, 

5. The problem of military job classification, evaluation and personnel 
utilization is constantly assuming added .significance. Peril aps some of 
the ideas set forth in this presentation will in some anuill way elicd addi- 
tional light upon these intricate problem, s. 

Received October 17, WU. 



Aircraft Recognition: II. A Study of Prognostic Tests * 

Lester Luborsky 

Duke Unimrsily 

The present article reports an attempt to determine choracteristica of 
the individual which influence his final level of performance in short-ex- 
posure aircraft recognition training. It was hoped that the approach 
followed would permit (a) the construction of a prognostic test battery, 
and (6) an analysis of the concomitants of the final level of performance* 
Because of the dearth of knowledge on this subject, the selection of 
factors to be studied was necessarily dictated by personal opinion as to 
the factors most likely to be involved, the possibilities of rapid measure- 
ment, and certain related aspects of importance in the life situation to- 
wards which the Navy recognition training program was directed. An 
instance of the last is speed of recognition. 

The data in this paper were obtained during a previously reported 
experiment (2) in which 4 equated groups, totaling 30 subjects, were 
taught aircraft recognition in a standardized manner. The subjects 
were pre-aviation V-5 students at Duke University. 

Before training, a battery of "pre-tests" was administered which was 
intended to (a) measure possible perceptual and learning factors associ- 
ated with "aircraft recognition ability” and (6) aid in equating the groups. 
After training, an extensive battery of "post-tests” was administered to 
facilitate analysis of the final level of performance. It is the scores of all 
subjects on these pre- and post-tests and on the Final Test of aircraft 
recognition which comprise the main data of this paper. 

In accomplishing the first aim, the selection of tests which have 
predictive value for the outcome of training, the procedure essentially 
was to correlate scores of all 30 subjects on the pre-tests with scores on 
the criterion test, in this case, the Final Test. The tests which correlated 
significantly were treated by the Doolittle technique to obtain the multi- 
ple correlation with the Final Test and the percentage of the variance 
accounted for by each test. A further subsidiary aim was to obtain at 
least suggestive evidence as to the concomitants of the final level of per- 
formance in aircraft recognition. This was based upon the intercorrela- 

* Part of a thesis submitted in partial fulfillment of the requirements for the degree 
of Doctor of Philosophy in tbo Graduate School of Arts and Sciences of Duke Univar- 
aity, 1946, 
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tions of all testa, pre- and post-, and tlu; necessiirilj’ .sul)j<;ctive estimate 
of what each test tests. Because of the relatively a])parciit meaning of 
some of the tests, such as A. C. E. P.sychclogicnl Examination and the 
Test of Previous Knowledge, and the large nninher of test intercorrela- 
tiona, the task of interpretation was considcrahly facilitated. 

Procedure 

Glasses were held for 46 minulcs on Monday, Wednesday and Friday 
for a 6 week period. The pre-tc.st.s Ji.sted in I'alde 1 woi'e ndiiiini.stGred 

Table 1 

Corrclationa of nil DnU with the Critcrifin 
Pie 1, Pre 2, iind Post Refer to the Time of Aflininifil ration 


Span of Apprehension* 


Inieresl 1 

.53 

Pre 1 

.13 

Interer^l ll (Jmproveinont) 

.47 

Pro 2 

.05 

Previous Knowledge of Planea 


Post 

.01 

Pro 1 

.41 

Improvcmciifc Pre 1 — Post 

-.13 

Ueaciion Time 


Improvement Pro 2 — Post 

.05 

JJght 


Memory Location 


Pre 1 

.02 

Pre 1 

.11 

Post 

.03 

Pro 2 

,10 

Common Objocls 


Post 

.18 

Pro 1 

.18 

M mory-Compleje Figures ^ Part 1 


Post 

,41 

Pru 1 

.38 

Improvement Pro 1 — Post 

-.06 

Mmory-CompUz /'Vgwrea, Part 2 


Rccognilion of Planoa 


Pro 1 

.20 

Post 

.26 

MmoTy-AirpUine iieco[;nitxoTi Aspects 


A.C.E, Psi/cliolopfcal J^araintimlioa 

.16 

Pro 1 

.29 

Grades in Academic Work 

.14 

Post 

.20 

Study Time on Aircraft RccognUion 


Memory-Complex Figures ^ 6** 


Srd Week 

-.57 

Pie 1 

.03 

Study Time on Aircraft Recognilion 


Acuity 


4ih Week 

-.43 

Pro 1 

.03 


Post 

.30 



Improvement Pre 1 — Post 

.54 




* Correlation cocfTicients after scoring by an nlicrnative molliocl (iimL. =t) are: 
Pro 1 = .10; Pre 2 = .19, and Post = .06. The consifltent lack of corrclaLion ia impor- 
tant because this test lias been used in some recognition kcIiooIb before Iraiiiing on the 
assumption that it improved airrnift recognition alhlily. 

on two successive evenings 3 days before the training period began. The 
''Pre V* tests were given on the first evening and the "Pro 2" teats, which 
were alternate forms of Pre 1 tests, were given on the second evening. 
The post-tests were on the Monday and Wednesday classes of the last 
week. These teats also were alternate forms with the exception of 
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Acuity and Recognition Time for Planea. In addition to the above, A. 
C. E. Psychological Examination scores and Grades in Academic Work 
were obtained from the Dean's office and Aircraft Recognition Study 
Time was obtained from a questionnaire on study habits. 

The experimenter operated a Bal optic an with a shutter attachment 
for obtaining 1/50" to 1" exposures (by calibration^ 1/40" and 4/5" 
respectively). The stimulus figures were projected on a screen about 5 
feet from the subjects. The testing was done in groups no larger than 
8 to lessen the possibility of differences between subjects caused by 
seating position,^ The less essential details of the apparatus and testing 
conditions are more fully described -in another article (2). 

Description of Tests ^ 

1. Span of Apprehension {Pre Pre 2, Post). The subjects were required 
to Gstimate the number of 5 centimeter ^ randomly arranged horizontal lines 
flashed on the screen for 1/50", The projection area of the screen was approxb 
matcly 15" X IS"* _ Each teat contained 10 exposures with 4, 6, 8, or 10 lines 
in each, The scoring was done in two ways: (a) the number of incorrect 
eatinmtes, and (b) tlie sum of the deviations from the actual number of lines 
exposed. 

2. Mmorij-Locaiion [Pn i, Pre 2, Post). A test of ability to reproduce on 
a grid sheet the location of a group of X 5" rectangles flashed on the 
screen for 1/50", Each test contained 12 exposures of 6, 6, or 7 rectangles 
each. The score for each grid was the total of the omitted and incorrectly 
fillcd-in grid spaces. 

3. MeinoTy-ComplB:c Piguns^ Pari 1 , (Pre 1). Subjects must repro- 
duce simple geometric line figures presented for 1/50". Only 1 exposure was 
given for each of the 4 figures constituting the test* An arbitrarily-devised 
scoring system credited one point for each of 4 aspects of each figure. 

4. Mewiory-Compfex Figures, Pari 2, ll60^' (Pre 1). Subjects must repro- 
duce geometric line figures of greater complexity than in Part 1, presented for 
1/60", Each of 3 figures was given 4 times in succesfaiaii and after each presen- 
tation the earlier reproductions were covered with the left hand wliile the now 
reproduction was drawn. The scoring was 1 point for each of 6 arbitrarily 
chosen aspects of each figure. The points for each reproduction were totaled 
to yield a score for each figure. 

5. Me mo ri/- Airplane Recognition Aspects, IjBO** (Pre 1, Post). Plan view 
diagrams of airplanes, taken frojn Aeronaniics Aircraft Spotters^ HanUhooh (1) 
were presented for 1/50", Sixty-five seconds were allowed after each exposure 
of a plaiie to checlc the presence or absence of 14 recognition aspects on a 
mimeographed check list. Subjects were informed that tliese were planes 
which were infrequently used and hence unfamiliar to them (as, e.g., Loire- 
Oliver 45 , Falclio, Morane-Saunier 406). Before starting the test every effort 
was made to be sure that the recognition aspects in the clieck List were com- 
pletely understood. To equalize the amount of guessing, subjects were directed 

^ Analyeia showed no diffcrcncca duo to acadng position. Staff, Psychological Test 
Film Unit (3), mention like conclusions. 

* Fuller descriptions and iffusLrnLions of the test matcriafs arc presented in the doc- 
toral dissertation available through Ihc Duke University Library. 

^ Five centimeters after projection on the screen. Tlie incrcoac in size on projection 
is 1 to 6. 
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to leave no omiaaions. The Pro 1 test contained 10 plancfl; and Post test 
contained 6 additional planea. 

C, Memonj-Com'plex Figitres, B” {Pre i, Pre ^)- Tliis teat is Himilnr to the 
Memory for Designs test in tlio Sbaiiford-Biiiet. Tlio 2 cards i[i Pro 1 were 
cilmoat identical with the test cards in Venn L and M of the {litauford-Binot. 
Each teat card coiitaiiicd 2 figurca which were presented simultaneously for 6"'. 
After approximately 3 Hcconds subjects were romiiuled to look at l)()th iigurea. 
The figures on the Pro 2 cards'* were c()nsi(l(3nibly more complex tlmu those of 
Pre 1. A more refined scoring than that used by tho Stanford-Hinot was 
devised — I point for each of 5 aspects of the first figuvo a ml I point for each 
of 3 aspects in tho acoonj figure of each card, 

7. Acuity (Pre f , Post), This lent employed tho Snellen Symbol R Charb.^ 
The Biibjcct iiidicatecl the direction oF tho open cnil of tho E using two-eyed 
vision. Tho acorc was the number of E'b correctly read, on a chart rvifch 
38 letters. 

8. hiteresi /, and 0, Interest 11. Tlicae teats were given at tlio end of the 
fourth week of training. By way of intro thicti on > tlic cxpeTimentor stated 
that some planes would be de.^^cribed which would not be inchidecl in tho course. 
HoweveTj Btiidcnts might bo interested in these planes aincc they were com- 
monly used in training aviation personnel and in passenger florvico, A teat 
was given of 6 planes, 3 views for each, to see how many were already known 
before tDaching. This teat will be referred to as IntcrcBt I. The names, 
recognition fcatiirca, and interest items for eacli plane were then diseussed 
while viewing each plane for approximately 2 minutes each, Immediately 
after this teaching and without any previous warning another test was given 
to Bcc how much had been learned. Tho Interest II scores are the improve- 
ment from the first to tho second test. The acorcs on both tho Interest I teat 
and the Interest II test are considered as interest measures — tho former on the* 
assumption that tho.io abudents interested in aviation would have known more 
of the common planes, and the latter on tho assumption that those students 
with greater interest would bo more receptive to tho teaching. 

10. Ptmous Knowledge of Planes {Pn 1). This teat contaiuccl 33 of the 3G 
planes to be included in the syllabus, given a 3" exposure for each. All were 
plan view diagTams. 

11. Reaction Time, Before and after training^ reaction times were taken 
for (o) seeing n 1/50'^ light flash on the projection screen, and (h) naming 
common objects, such as umbrella, book, cat, etc., flashed on the projection 
screen for 1/50^'. These two kinds of reaction time were expected to prove 
useful when the rccoguition time Cox planes, measured at tho oml of training, 
was to be interpreted. Tho subjects were required to lift their forefinger from 
a abimulua key in circuit with a standard timer to indicate recognition and 
then name the plane,® 

12. American Council on Education (A. C. E.) Psychological Ea:aminalion. 
Scores on this teat (total score on linguistic and quantitative sections) wore 
obtained from the Dean's oflicc. Most of the tests had been administered 
duiing the previous Bemeater. 

13. Grades in Academic Work. Tho Dean's office also supplied tho pre- 
vious semester's grades in academic work. Scores are tho average of point 
equivalents for each grade: 13 points for a grade of A, 10 for B, 7 for G, otc. 

< It was found that thia eeb of Bblmulus cards correlated highly with Pro 1 but with 
no other test. The greater complexity of these figures probably introduced an addi- 
tional influcncs to that measured in Pro 1. 

« American Optical Co., No. 1042. 

* The writer ia indebted to Mr. Walter Knight of tho Department of Physics, Duke 
University , for constructing tho clfioicnt reaction time shutter atlachmont. 
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H, Study Time on Aircrajl Recognition^ 3rd Weeh. 

15. Study TiiHe on Aircroft RecogniCion^ J^ih Week^ The tini6 spent in 
studying aircraft recognition outside of class was recorded on a questionnaire 
on study habits. Tlie total time in minutes for eacli week was used for corrc'- 
lation purposes* 


The Criterion Measure: the Final Test 

All testa were correlated with the 1/50^' Final Test which was admini- 
stered at tlio ciglitccntli session, the last session of the course. In the 
last 2 weeks of this course all groups were trained at the 1/50^' standard 
and given many views of each plane. One picture and one diagram view 
of all 30 planes tauglit gave a total of 72 exposures in the 1/50'^ Final 
Test. This test was longer and more difficult than any previously given. 
The split-half mliabiUty coefficient wag -h.77. 

Results and Discussion 

Tests with Significant Correlations with the Pinal Test and with Each 
Other. The correlation coeflicients of all testa with the criterion are 
presented in Table 1. Table 2 presents only those pre-tests with signifi- 


Table 2 

Main TcbIs; Correlation with Criterion, Reliability, and Significant 
Correlations with Other Teats 



r with 
Final 
Teat 

ReJi ability: 
Sclf-r 
or 

Teat-re test 

Significant r's with Other Test^ 

1. Memory- Complex Figures, 

.38 

Vartl\ 


Memory- Complex Figurcif, 

.30 

Part 1, 1/60'^ 


Part 2 1 


6'' 


2. Memory-Complex Figures, 

.03 

Pre 1 \ 

7A 

Memory-Location, Pro 2 

.54 

6'' 


Pre2| 

. f't 

A.C.E, Psychological ISx- 






flinination 

.43 





Memory-Complex Figures, 






Part I 

.30 

3. Previous Knowledge of 

.41 


.74 

Interest I 

.43 

Planes used in the 






Syllabus 






4, Interest I 

.53 


.42 

Previous Knowledge 

.43 

6. Interest II 

.47 


♦ 

A.C.E. Psychological Ex- 






amination 

.64 


* No aatia factory method is available for finding the reliability of this improvement 
acore. However, an improvement score cannot be reliable if the testa from which it is 
calculated arc unreliable. The split-lmlf reliability of the test from which Intel eat II 
is derived are .42 and .52 respcclively. 
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cant ^ Gorielationa aud also includes their rclial)iliLy coclTicients and a 
list of other pic- and post- tests with whicli these correlate significantly. 
The highest correlations with the criiorioii (Taldc II) aj c ( 1 ) Memory- 
Complex Figures^ Part 1; (2) Memory-Complex Figures, 5''; (3) Previoua 
Knowledge of Planes used in the Syllabus; (4) Interest I, Knowledge of 
Planes (trainers and passenger); (5) Interest II, Iininovement in Knowl- 
edge of Planes (the same planes as in Interest J), Thu significant cor- 
relations of these "'maiid' tests with other tests should give some hints aa 
to tl\o naUwo of tho^o uvaiw tota and at the. naiue time ti Uoltev \mdov- 
standing of the nature of ^'aircraft recognition ability,” This i)rablem 
will be more profitably considered after arriving at an estimate of the 
variance contributed by each jnain test to the total variance, 

Developvienl of a Progrioslic Test Ballenj. In the development of a 
prognostic test battery, the intcrcorrelations of 5 main tests and the 
Final Test were treated by the Doolittle technic|ue and a inultijilc cor- 
relation {li) of .855 obtainocb The index of forecasting cflicicncy ig 
48.2%. The standard error of estimate was found to be 4,09. This 
means that in 07% of cases the predicted criterion score will bo within 
4.09 points of the actual criterion score. The R lins a cocflicient of 
nuilti])le determination of approximately 73% of the variance in the 
Final Te.st. Each variable contrilniLc.s tlio billowing amount to the 
total variance: Xs, Memory-Complex Figuros, Part 1 , 1/50”, 8.0%; Xa, 
Memory-Complex Figures, 5”, 28.9% jX^, Previous Knowledge of Planes, 
9,5%; Xe, Interest I, Knowledge of Planes, 13.0%; and Xo, Intero.st II, 
Improvement in Knowledge of Pianos, 13,0%. lly far the greatest con- 
tribution is made by Memory-Complex Figures, tT^ Interest I had 
Interest II malce the next greatest contributions. However, all contri- 
butions are large enough to make it dcsiniblc to use all tests if this 
battery were to bo used prognostically. 

Beta weights were then computed and the following regression equ- 
ation for predicting the criterion, scores from the 5 tests was found: 
Xiprcd. = -3.100 + 1,033 X2+ 1.815 Xa + 0.443 X^ + 0.576 X 5 + 
0.117 Xo- 

It was suggested above that all of the tests shoukl be used tor prog- 
nosis since none of the variance contributioiin is sinall enough to disregard, 

^ All correlations must bo .30 to bo significiinL at LI»o 5% level and .40 to bo flignifi- 
canL at the 1% Icvct. 

® BincG the higbesL obtiiincd mrrolaiioii cocfTicieni betweeu winscuiuLivo airorafl rcc- 
.04, u cuTTcciion Sot uUommtion wemUi consickrah^y inmsnic v^\ 
cor rol at ions, Ilowcvei, it was tliouglit moro desirable in this preliminary study to 
prCBent all Ibc eoDlHcicTits exactly as obtained nnd merely note the fact that a correction 
for attenuation would liavo the effect of increnaing all cocflicicnta by 1/V.044 or c.g. if 
r - .3a, Tc = .48. 
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Use of all tests presents no administrative difficulties, since all testa 
would take less than 45 minutes.® However, after this battery is vali- 
dated on another new and larger group, it may be found that inclusion of 
some of the testa is not economical. Furthermore, it is likely that length- 
ening of certain of the tests will result in an even greater R, The high R 
already obtained indicates that the preliminary search for prognostic 
tests appears to liave succeeded in sampling the major areas contributing 
to suGceaa in aircraft recognition training, 

Table 3 

Diagraninifltic Analysis of InterrelatioMhips (Significanfi Correlations) Betw^een the 
Main Teats;* Final Test and the Main Teats; and the 
MainiTesta^and Other Testa 


Kind of Factor 

Main Teats 

(Correlated Significantly 
with Final Teat) 

Testa Correlated 
Significandy 
with Main Test 
but not with 
Final Test 

Memory 

Measured before Training: 

Memory -Complex Figures, Part 1, 1/50'^ 



Memory-Complex Figures, 5" 

. .Memory-Location 

Foat Knowledge 

Previous Knowledge of Planes 

A.C.E, 

Interest 

Interest I 

Interest II . 

. .A.C.K 

Acuity Iznprov. 

Measured after Training: 

Improv. in Acuity 


Reaction Time 

Reaction Time: Common Objects 



(Post) 

. .Reaction Time; 

Study 

Study Time for Aircraft 

Recognition of 
Planes (Post) 


Recognition** 



* Main testa which nro significantly correlated are bracketed. 
** A negative correlation. 


Analysis of Conditions Influencing Performance. One aim of this 
experiment was to obtain at least suggestive evidence which would in- 
crease understanding of the concomitants of successful performance. 
The variance contribution of each pre-test to the total variance is pres- 
ented in the preceding section. In the present section a more complete 
analysis will be attempted. ¥ or this purpose all tests, rather than only 
the pre-tests, with significant correlations with the criterion, must be 

® Adini Ilia tra Live time required for each teat: ^ five minutes; Xa — five minutes; 

Xi =i ten minutes; Xi = five minutes; and Xt = twenty rainiitea. Total ad minis bra- 
fcion time = forty-five minutes. 
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considered. In addition, these tests might he l)cttcr understood by 
conaidering tlie tests with which they, in turn, correlate significantly, 
The diagrammatic analysis in Table is based upon Imth sets of correla- 
tions. 

A hypotlietical analysis of tho conconii bants of succc-ssful porformanco 
baaed upon Tabic 3 might he as follows: 

(a) Memory for complex figures, jicrhaps of a vi.sual memory Lype- 
Eoth memory at 5" and 1/50" exposure arc involvc(l l)ut particu- 
larly the former. 

(h) Past interest in learning planes and resultant knowledge of some 
planes. 

(c) Interest and intelligence which permits ready learning of 
planes. 

id) A tendency to adapt to the visual conditions domanclcd by the 
mode of presentation of planes. This is an inference from the 
Bignificanfc correlation of Improvement in Acuity and the Final 
Test. 

(e) After training there is ability to recognize and name common 
objeefa more quickly iincler sliort exposure pre.sentatiou condi- 
tions. 

(/) Existence of the above make a great deal of studying uii necessary. 
Another possible interpretation is that much study of the kind 
done actually interfers witli proper learning. 

It is possible to infer from the variance contributions i)i*cviously 
determined that the first 3 concomitants listed above arc important for 
successful performance in the order listed, The factor which contributes 
the most to the final level of performance is the ability to remember com- 
plex material, relatively independently of exposure time. The past 
knowledge factor which contributes the second largest amount may also 
be considered a memory factor. 

Summary and Conclusions 

The data for the present report were obtained almost entirely from 
tests given before and after an aircraft recognition training course. A 
prognostic battery and regression equation were found I)y applying the 
Doolittle technique to pre-tests with significant conelationa with the 
Final Test. All of these selected pre-tests wore found to contribute 
sufficiently to the total variance to warrant inclusion in tlie prognostic 
battery. Because of the high multiple correlation of .85 and the case of 
administration of these tests, validation of tlie battery on a new and 
larger group of students is recommended. 

Although the intelligence measure (A. C. E.) did not corrolntc significantly with 
the Pinal Teat, it did correlate highly with Intcrcab II, 
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On the basis of the significant correlations between individual teats 
and the criterion, a hypothetical analysis was attempted on the concomi- 
tants of achieving successful performance in recognition under conditions 
of short exposure. Tliese concomitants are briefly as follows : (a) memory 
for figures; (b) previous knowledge of planes; (c) interest and ability in 
learning planes; (d) adapting to the short exposure visual condltiona; 
(fi) quick recognition of common objects after short exposure training; and 
(/) comparatively less home study. 

These relationships should hold particularly for recognition of this 
specific stimulus material. However, there is good reason for supposing 
that the relationships would hold for recognition of material of comparable 
level of complexity and of similarity within the group of items. 

Furthermore, the data presented in this section are of great utility 
for future experiments. The analysis of concomitants of achieving the 
final level of performance would enable a more complete equation of 
groups than was possible before this experiment, and would open the 
way to final answers to the kinds of problems described in an earlier 
experiment (2) on the relative efficiency of training procedures. 

Received Oclober 18, 19U. 
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Psychological Principles in Army Administration 

Louis L. McQuitty,* Lt. Col., AGD 

Vnivcmly Training Command, HfTOUSA, AVO Ifi, c/o Poulmnahr, 

New York, N. Y. 

The (irmy encompasses a tremeiulou.s adininislniLivo rosponsibility, 
This is true both from the point of view of the number of individuals ad- 
ministered and from the many details of liiimnn l)oliavicu- minutely 
affected. Some military psychologists have i)rovcn so siuicessful in their 
approaches to administrative {)roblems that their commiindorH have 
placed them in larger admiiiislrativc duties involving fascinating and 
practical psychological problcm.s. Most of tiro psychological problems 
posed cannot be referred for final solutions to established la\v.s, principles 
or axioms. An Alternative apirroach is to oirtain ns much in.sighfc as 
possible through discussions by those trained in fields of knowledge 
closely related to the problems. This pajicr represents ono such dis- 
cussion. It outlines tried racthod.s of .solutions to army adiniiiistrativo 
problems and suggests the psychological principles from which they 
appear to derive. 


Administrative Organization 

One of the first problems containing ixsychologlcal implications with 
which the array administrator must concern himself is the type of per- 
sonnel organization he is going to install in order to accomplish the mis- 
sion for which he is responsible. The size of the mission is often so great 
that the administrator cannot nccomplLsli the job by himself and cannot 
even keep himself informed on all of its many aspects. It is thevefove 
incumbent on the administrator that he divide tlic mission into goals and 
assign the goals to sub-administrators. 

The division into goals should be based on a careful study of the 
mission. The mi.ssion requires execution of certain work functions in 
order to accomplish it. These work functions form cliistcr.s in the sense 
that the component functions of any one cluster arc highly doimiidcnt 
upon one another but arc relatively indo])ciukiut of llic functions of other 
clugtcrs. The division of the mission into goals should be so iiccomi)!iHlied 
that each goal representa a cluster of work functioius, An ilUi.stration of 

• On military Icuve of nl)acncc from the Dcparlmctit of Paychology, University of 
Illinois. 
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thia point ia readily available in the consideration of personnel adminis- 
tration and classification responsibilities as a mission. One possible 
division would be to have a personnel administration section and a classi- 
fication section. Each section would handle its particular responsibilities 
as they pertained to both officers and enlisted men. An alternative 
division would be to have an officer section and an enlisted section. Each 
section would handle personnel administration and classification func- 
tions, one section as they pertain to officers and the other as they pertain 
to enlisted men. A comparative study of these two alternative divisions 
reveals that soldiers on duty in the officer section could operate satis- 
factorily with little reference to soldiers on duty in the enlisted section. 
The work functions represented by the officer and enlisted sections con- 
stitute clusters and the clusters are relatively independent. This condi- 
tion is just the opposite of that which exists when the division is into 
a personnel administration section and a classification section. The 
soldiers on duty in these two sections must be continually communicating 
with one another in order to function satisfactorily. These two sections 
do not represent independent clusters. 

The division of the mission into goals represented by relatively inde- 
pendent work clusters, as purposed herein, is considered to be desirable 
because of the following reasons: 

(1) It minimizes the amount of coordination needed; (2) It lessens 
the chances for personality frictions which are apt to occur when persona 
of equivalent rank and responsibilities have to coordinate and determine 
for which aspect of a mission they are responsible; and (3) Each sub- 
administrator has the maximum amount of autonomy possible within 
army organization. Practically all his dealings are with his immediate 
superior or his immediate subordinates. 

The administrator, unless he is charged with a small and minor mis- 
sion, will find it advisable to delegate to aub-administrators all of the 
duties contained in the mission. This will leave the administrator free 
to discharge the responsibilities of genera! supervision, coordination with 
those on an equivalent administrative level, and to report to and receive 
directives from his immediate superior. General supervision should 
include: (1) A review of non-routine work submitted to higher authority; 
(2) A review of the assignments of incoming non-routine tasks to sub- 
administrators in order to assure that the original division into sub- 
missions is followed or revised when appropriate; (3) A continual review 
of personnel allotments to the sub-divisions in order to maintain equiva- 
lent work loads for all concerned as the amount of work charged to the 
aub-divisions fluctuates; and (4) Inspections of the accomplishments of 
sub-administrators. 
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If the adminiatmtor follows this plan of office organization, he will 
usually discover that from four to six ia the appropriate number of sub- 
admmiafcrabors for hia immediate supervision. 

Having attempted to so organize the functional uHiuicts of the olRee 
to assure wholesome rclationshipa between pcrsoniiHtics, the administra- 
tor can further the realization of tlic desired ends by an ai)pro])riato dis- 
tribution of office space, Thia slatcmctit is ba.sed on tlie asHiimj)tion 
that desired cooperation is more likely to onsue if it is made easy, tho 
parties concerned are friends, and each apijrcciates the prolilems of the 
others. It is believed that these latter conditions are UHunlly achieved if 
the aub-adminiatrators arc placed in the same office or in adjoining officea 
and communication between them is readily available at all times. 

It is felt that the above suggested organization tends to facilitate 
smooth operation because it decreases the chances Cor personality frictionfl 
by lessening the possibilities for misunderstandings and frustrations. 
It charges the administrator primarily with tlio job of making the organi- 
zation function properly. This enables him to forsoo possible personality 
diffloulties before they arise and to act to correct them before they become 
serious. 

Having organized the office, both from the point of view of space 
assignments and functional responaibilitica, there arc tho problems of the 
relationships of the administrator to his sub-administrators, to his co- 
adminiatratora and to hia BViperior. 

RelationshipB between Admimstrator and Superior 
The significance of the relationship of the administrator to his superior 
ia realized in part when one recalls that in army life a soldier is responsible 
to his superior for practically everything he does or fails to do. It is 
therefore incumbent upon a soldier administrator to build a wholesome 
relationship between himself and his auperior. In order to achieve this 
end he ahoiild learn the details of hia superior's personality. Ho should 
listen very attentively to everything he says. He should study his 
motivationa and attempt to predict his reactions to situationa os they 
arise. He should put tactful questions when answers to these assist him 
to know better the desires of his superior os they pertain to military 
matters and when the questions can be put without arousing offense. 
These suggestions derive from the principle that there are wide individual 
differences in superiors and what might appeal to one would be acted on 
unfavorably by another. The solution is to know tho auporior to whom 
one is responsible as well as possible bo that appropriate matters may be 
presented in a manner so aa to be favorably received. 

Despite the individual differences in superiors there are usually some 
principles of approach that will be favorably received bv most of them. 
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It is well to be acquainted with these because in army life there is often a 
clmngc in the individual to whom any one is responsible, and the gener- 
ally acceptable principles have to be I’elied upon until one can learn the 
personality characteristies 0 / his new superior. One can try the generally 
applicable lU'inciples and observe closely their effects. He can revise 
them in the light of hin observations. 

Primary among the generally acceptable principles is the desirability 
of putting one's suggestions for the accomplishment of tasks or goals too 
his superior in such a way that they imply that the administrator fully 
realizes that decisions on the matters arc the prerogative of the superior. 
If any of the suggestions are adopted and prove successful, the administra- 
tor can usually motivate wholesome relationships, if he makes inherent 
in his report of the success to the superior the realization that it was the 
judgment of the superior which decided in advance that the ideas would 
bo siicces8lu}> This tends to encourage in the superior the feeling of 
ownership for the i3rogram involved and thus the program obtains his 
support more effectively. Several repetitions of this nature create in the 
superior more and more of a feeling of personal ownership for all of the 
programs that derive from the administrator under consideration to the 
end that the latter obtains a very high level of support. 

On tliG other hand, if an idea suggested by the administrator and 
approved by the superior should fail, it is well that the report of failure 
include the realization by the administrator that he suggested the idea 
and accepts responsibility for its failure. The necessary derogatory im- 
pression ensuing from a report of failure is lessened by including a sug- 
gestion — particularly well thought out — to improve or substitute for the 
idea which failed on first trial, 

Many of the suggestions which the administrator recommenda to his 
superior will originate with his immediate sub-adminiatrators or even 
lower in the administrative echelon. It is well that the administrator 
credit them to the appropriate individuals when he recommends them to 
his superior because this is one way in which the administrator can en- 
courage his superior to the realization that hia actions ai’C not predicated 
on a mere desire to create a particularly favorable personal impression. 
In addition, to give the credit where due will help one's relationship with 
one's sub-ndministrators because the chances are the superior will ac- 
knowledge the contribution at some time to the sub-administrators con- 
cerned, and the Bub-administrators will feel kindly to know that they have 
been given due credit. 

At times the administrator will receive from his superior directives 
with which he may immediately disagree. It is wise that he be hesitant 
about expressing his disagreement unless invited to do so, and then it 



m 


Lonia L. M cQuilty 


should be done reservations. It may be that the superior, and even 
his eiiperiors, have spent a great deal of time thinking through and study- 
ing the directives. The clirectivos may be the product of trcinendoua 
efforts. For the administrator, a j\iniorj to object with little apparent 
study may not portray due respect and may bo unfavorably received 
because of tlie apparent failure of the administrator to give due study to 
the directives before voicing his attitude toward them. Also if he takes 
time for himself and his sub-administrators to study them and report to 
him he may arrive at more valuable conclusioiiH, which will be more ro 
spected because they have first been given due consideration, and the 
superior may not be as emotionally intorcxsted in the directives as lie was 
soon after he may have spent hours working on them and thinking about 
them. Also the administrator cstablisheg an attitude of confidence to- 
ward himself if he is very cautious about raising problem^ in conueGtiou 
with directives to him. He may be able to establish in Ids superior the 
attitude that the latter should consider very carefully when the admin- 
istrator raises a problem. Such, of course, would be a definite asset to 
the administrator and would probably spread to become a more general 
attitude of regard by the superior toward the administrator. 

Another possible way to build a favorable attitude in the mind of the 
superior and to save him embarrassment as well as put him in a ])osition 
to justly defend the actions of his subordinates is for the administrator 
to keep the superior especially well informed on what transpires. This 
applies in particular when the administrator or his stall has been guilty 
of an oversight or some other type of negligence or when occasion has 
required the issuanco to commanders of lower echelons directives to 
which they are expected to object. The cliancos ore the negligence or 
objection will be reported through command channels and will come to 
the superior from personnel to which he is responsible. He can do much 
to retain cooperation and understanding among all concerned if he ia in a 
position to give immediately the full story on the matter under considera- 
tion. 

There ia of course always a question of the minuteness of matters of 
potential objection and negligence which should be reported to the super- 
ior by the administrator. The answer to tlii.s problem depends on the 
personal preference of the superior and can usually bo discovered by 
appiopviatc questioning when such matters are reported. Ills preference 
will usually reflect the attitude of the individuals to whom he is responai- 
hle and the tendencies of lower and higher commanders in reporting 
objectionablQ matters. Some commanders will attempt to report their 
objections with reasons to the office which issued the directive involved 
and which appears to be immediately responsible so that a more satis- 
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factory arrangement may be evolved at that level if possible. Others 
will invariably report their objections to personnel in higher echelons of 
adminifitiation and therefore make it desirable for those personnel to 
keep well informed on the matters because they can thereby niako a more 
favorable impression on the objecting commander*; who usually ranks the 
administrative personnel, to the end that cooperative understanding has 
a better chance of continuing. 

Ihe points just outlined covering principles that are considered gen- 
erally helpful to an administrator in adapting to his superior are predi*« 
cated on the belief that personal understanding between the two con- 
cerned is of 'primary importance, that the administrator as the junior 
should consider it his responsibility to make whatever adaptation is 
necessary to accomplish the desired relationship; that the administrator 
should regard himself ns an assistant to the superior in the accomplish- 
ment of the latter’s mission, that frankness and cooperation are essential 
to personal understanding, and that credit will accrue to those to whom 
it is due much more readily if they make no obvious moves designed 
merely to enchance it — and besides — self credit, especially in a war effort, 
is of no consequence; the one great dedication should be successful and 
efficient prosecution of the war. 

Relationships between Administrator and Sub- Administrators 

The fundamental fact to keep in mind in considering the relationships 
of the administrator to hia sub-administrators is that the discussion is 
here pitched at that echelon where the size of the mission is so large that 
its accomplishment has been entirely delegated — ^leaving the administra- 
tor free to give his full time to the supervision of his subordinates. The 
administrator is dependent upon his Bubordinates for accomplishment of 
the mission, and his success depends on his qualities of leadership in a 
particular field. His job is to assure that the maximum achievements 
are realized by his subordinates. These achievements must be realized 
as a functional component of a much larger whole. They must be ap- 
propriately adjusted to the much larger functional framework. The 
administrator must therefore be a successful teacher. He must be able 
to give his sub-adminiatratora a clear concise picture of the mission for 
which he is responsible. He must be able to give a significant and mcan- 
ingful picture of how this mission fits into the larger framework. He must 
be able to teach each sub-administrator to realize and comprehend Jiis 
particular goal in its perspective to the goals of other sub-administrators 
and in perspective to the still larger functional framework. He can test 
hia success. If his subordinates are making recommendations which his 
knowledge of the overall situation frequently reveals to him are inap- 
propriate, then he is not keeping his subordinates sufficiently well in- 
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formed — and if he is passing these recommendationa on approved to 
higher administrative echelons where they arc not favornl^ly considered, 
then lie is not keeping himself nor his subordinates siilFiciently well in- 
formed. The suggestions just offered are boli(;ved to derive from the 
principle that appropriate achievements depend on clear cut under- 
standings of iniHsions and that one chariicteristio of lospcetcd leadership 
depends on an unbiased ability to search oneself and oiie^s organization 
for shortcomings before blaming oiie^B siibordinaLcs. 

If the sliortcomings are discovered in oneself, oncj must take immedi- 
ate steps to correct them, and one way that one can usually assure liimself 
that he and hia subordinates arc sufficiently well informed to properly 
discharge their duties is to attempt to keep himself aufficiGntly well in- 
. formed to accompliali the mission of liis superior and frankly attempt to 
keep his immediate eubordinates sufficiently well informed that any one 
of them could step into his position. This 1ms the effect of keeping a 
personal goal immediately in front of all personnel concerned and acts as 
a strong motivating factor. It also makes a very favorable impression 
on superiors to observe the continued smooth functioning that ensues 
even though key personnel arc suddenly lost aa so frequently hii[)pen 3 in 
many army organizations. 

The above suggestions encourage successful leadership through careful 
inabriicbions to subordinates. Another method of giving diroction to the 
work of subordinate is for the administrator as the lender to assist hia sub- 
ordinates to know his personality chnraoteriatics. The better able he is 
to acquaint them with hia personality characteristics the better able they 
will be to follow his dCsSires. He will assist his subordinates in this respect 
if he always gives reasons for his decisions. In addition, this policy 
makes him very careful of his decisions and often prevents him from 
making enovs of decision, especially so, if he creates in his subordinates a 
feeling of freedom to express clisagreonienta. This feeling is enhanced if 
such expressions arc always given careful and tactful consideration and if 
appreciation is shown for them even though they arc not accepted. The 
approach just offered is believed to derive from the principle that freedom 
of action — herein fostered by an overall knowledge of the mission plus 
responsibility for definite goals — encouragea initiative. 

Initiative can often be still further encouraged by emphasizing respon- 
sibility to personnel to whom goals lire ftfisigued. Such personnel will 
sometimes come to the administrator with questions designed to obtain 
the solution from liim — and for the administrator to give it will encourage 
dependence upon him at the expense of properly developing his subordi- 
nates. 

The assignment of goals also obligates the administrator from the 
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should at least give them an opportunity to express their opinions on 
matters prior to a decision having been made. To comply with this 
obligation should not only assist in developing and maintaining desired 
personal relationships but should also produce valuable ideas which 
might otherwise be overlooked. 

The suggestions enumerated above are based on the principle that 
smoother personal relationships are maintained and more is achieved 
when all personnel are given a clear cut understanding of thair responsi- 
bilities, are taught to exercise their initiative, and the initiative of all is 
given proper direction by means of keeping all personnel sufficiently well 
informed so that they have proper perspectives for expressing themselves. 

Relationships between Administrator and Co- Administrators 

By keeping oneself especially well informed and by thinking out ones 
decisions with ones sub-administratorS; as just outlined; the administrator 
keeps himself peculiarly adept to deal effectively with his co-admin istra- 
torsp with whom he must cooperate and with whom he is often in competi- 
tion. He must cooperate with them because all are working for the ac- 
complishment of the mission of their common superior and for the greater 
goal of successful and efficient prosecution of the war. He is often in 
competition with them because all are often highly motivated by the 
superior, all are rated as to efficiencies by their superior, and disagree- 
ments arise as to how the mission of the superior should be accomplished 
and as to whom of the sub-administrators should be responsible for the 
various aspects of the mission. The adminiatraior who is well reinfoi ced 
by knowledge and carefully thought out principles has the advantage 
because he is prepared for discussion periods which usually arise suddenly. 
In alternative solutions that arise in these discussions he should take only 
efficient accomplishment of the mission of hia superior as the primary 
purpose, and this principle in conjunction with an unusual background of 
pertinent knowledge will give him a solution for which he can acquire 
support through an intellectual, non-emotional, presentation. This 
presentation will encourage better personal relationships if the intellec- 
tual contributions are offered in the form of suggestions and if the con- 
tributor takes advantage of every opportunity to evolve them from the 
personnel in the discussion. He will then usually be admired by hia 
colleagues and appreciated by his superior. 

The proposals herein offered for efficient functioning of an administra- 
tive organization are analogous to those often proposed for the healthy 
minded functioning of a human organism. They derive from the primary 
principle that efficiency will ensue in the organization, or organism, if 
there is a clear cut goal adjusted to the capacity present and if all com- 
ponents are carefully directed and motivated toward its realization. 
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Resuin6 and Psychologinal rnsaibiliticH 

This paper was motivated by tlio realization that nevi!r before have 
psychologists contributed so much in .so many iiHsignmnnlH heretofore not 
filled by pcnsonnol o-spccially trained in the understanding of behavior. 
The exigcneica of war and the success (d some military psychologists in 
non-spccialized aspects of their nssigmncrits have placed Iheiii in these 
pursuits. This uniisinil .situation demand, s (li,s(Ui.s.si(m in orcler that it Jnay 
be properly evaluated, in order that full advantage. »nay he taken of its 
opportunities, and— more siiccifically— in order that ii.syehologists in 
these assignments may take advantage of the conlribution.s of llieir 
colleagues. 

Tlie' paper outlinc.s p.sychologicnl npi)roar!h(;.s tliat have been applied 
to certain army administrative jirobloins. The (liscussion w pitclicd at 
that level wlicrc the administrator must depend entirely on his .subordi- 
nates for the accomplishment of the tasks. Ilis aeliiovrurnint depends on 
leadership and organization. He teaches liis subt)rdinate.s to uiulcr.stand 
dearly their goals in proper pcvspectivo t«» the larger missions. lie en- 
courages and devclopcs respon.sibility, initiative and determination in 
his subordinate-s and gives them the maximum authority jii.stificd by 
their iindonstanding of the missions. lie cstablislio.s an organization 
which facilitates wholesome personal relation, ships and wliieli minimizes 
the amount of coordination required. He motivates inaxiirmm eiTort 
and directs it into the channehs whore it is most productive. 

It is hoped that this paper will encourage other similar discussions. 
It may be that these discu.s.sion.s would reveal many jisychological ap- 
proaches which could be applied to \)ractical pursuits of pence time living. 
It may be that material could be gleaned for p-sychological courses in 
business administration aiad other practical siibjeets. It may be that 
many psychologists have been developed into practienl administrators 
and executives capable of outstripping their non-specialized competitors. 
And, it may bo that many occupational pursuits, now considered non- 
professional, involve so many psychological considcratioii.s that they 
could be more effectively discharged by personnel specialized in the 
understanding of human behavior. 

Remwd Awflust 20, 



A Statistical Study of Visual Functions and 
Industrial Safety 

N. Frank Stump 

General Personnel DeparimGni, Revere Copper and Brass Incorporated, 

Rome, New York 

The purpose of this study was to determine the statistical significance 
of differences between average visual performance for various accident 
groups. Three groups evaluated from first aid records were compared; 
(1) An Accident-Free group, (2) A High-Frequency-of-Minor-Accideni 
group, and (3) A Serious-Injury group. The employees were classified 
in each of these grou])s by the Safety Engineer, a Personnel Assistant, 
and the Author, after thoroughly examining the individual accident 
records for a twelve-month period. 

Visual Tests Used 

Twelve visual tests were administered to the three employee groups 
having various past histories regarding accidents. The complete set of 
tests are incorporated in the Bausch and Lomb Orlho-Raier} They are; 

1. Acuity, both eyes, far and near distances; 2. Acuity, each eye 
separately, at far and near distances (not occluded); 3, Vertical and 
Lateral Plioria,® or Muscle Balance, at for and near distances; 4. Color; 
and 5. Depth or Stereopsis. 

Since the tests for "Acuity, each eye separately" were administered 
without occlusion, both eyes were functioning normally, even though 
each was being tested separately. The natural-function method is far 
superior to the obsolete procedure of placing a cardboard before alternate 
eyes when testing, Unfortunately, this latter method is being generally 
used today for certifying auto drivers throughout the country, and for 
testing industrial employees during medical examination. 

Results 

Table 1 shows Means and Critical Ratios for 22 visual test scores 
including various score combinations. If raw scores from only twelve 
Ortho-Rater tests were considered, the number of comparisons between 
visual functions would have been limited. By combining these raw 

‘ For description of these testa see: Standard Practice in the Administration of the 
Banach & lomh Occupational Vision Tests with the OrUuhRaler, February, 1944. 

' Joseph Tiflin, Industrialpsychology. New York: Prenlicc-Hall, Inc., 1942. Ch. VI. 
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TiLl)le 1 

Mentis mill Crilicftl RnLioa of Tluee Acciilcnt ^iroupH Compnrtd with Uegnril to 
VnrloiiH ViBunl FuiK^lionw 

(NgL<i: 4 Accidcn(rl'>cc; /i ^ Iligli-Freaueiiry; C SiTicuH-Injiiry, N = 108.] 

Means Critical lUtios 


Tesla 

A 

Zi 

C 

M^-Mc 

M^-Afn 

JlfirWo 

1. Acuity'— ho til lOyeJJ — Far 

10.«l 

10. M 

U.83 

2.23 

1.09 

.05 

2. Acuity— Hi gilt Eye— Far 

0.80 

8.83 

8.86 

2.13 

2.20 

.05* 

3. Acuity — IjcftEyc — Far 

0.BG 

8.07 

8.01 

2.00 

2.08 

,08 

4. Acuity— TGlbcr Eye— Par 

10.63 

0.72 

9.09 

2.03 

2.21 

.06 

6. Acuity— WorsQ Eye — Far 

0.25 

7.78 

7.78 

2.63 

2,60 

.00 

6. Lateral Pliori ft— Far 

7.44 

0.72 

7.19 

.37 

1.26 

.67* 

7. Vertical PUoria— Far 

5.6G 

5.25 

4,02 

1,75 

1.02 

,80 

8. Acuity— 'Both Eyes— Near 

11.08 

lO.CO 

io,r>B 

.08 

.87 

.21 

9. Acuity— Right Eye— Near 

9-03 

8.58 

8.92 

.18 

.70 

.50* 

10, Acuity— Left Eye— 'Near 

0.01 

0.28 

0.06 

.02 

.57 

,33 

IL Lateral Phoria— Near 

0,33 

7M 

7.31 

1.23* 

1.02* 

,21* 

12, VertictLl Phoria — Near 

4.01 

4.01 

4.00 

1.84 

.00 

1.60 

1 3 . Lateral Phoria— N ear aub- 

tracted from Far, plus 10 

11.11 

0.68 

0.89 

1.77 

l.DO 

.39^ 

14. D^cttcrEyo— Ncaraul)" 

iracUsd from Far, plus 6 

6.63 

4.64 

4.80 

LOO 

1,63 

.eo* 

16. Worao Eye— Near sub- 

tracted from Far, plus 0 

0,01 

8.07 

6.68 

1.84 

L04 

.72 

1(J. Worflo Eye— Near 

8,64 

7,80 

8.17 

.77 

1,24 

.44* 

17, Better Eye — Near 

10.00 

I0.G3 

0.81 

.30 

.06'® 

.40 

18. Depth 

6.64 

3.53 

4.72 

1.31 

3.27 

1,00*' 

19. Color 

4,44 

4.26 

4.31 

.44 

.CO 

.17" 

20. Vortical Phoria— Near aub- 

traded from Far, plua 3 

3,89 

3.04 

3,92 

.08** 

.00 

.70** 

31. Acuity — Doth Byes — Near 

subtracted from Fur, plus 6 

4.72 

4.44 

4.25 

.82 

.67 

.39 


22. Total lor 7 tests — Both; 


Right; Left; Better; Worse; 
(Far Vision) Lat. Phoria, 


Near from Par; and Depth 
23. Education — Grades com- 

67.08 

58,25 

69.39 

2.00 

6.44 

.44'* 

pleted in Bcbool 

8.53 

9.00 

8.60 

.06" 

.90'* 

.82 


Expianation of footnote numbora: The following com hi nn Lions ahould read Mc-^Ma 
4, la, 10; Mb-Ma 5, 10> 17; and 1, 2, 3, 0, 7, 8, 9, ll. 12, 14, 16. 


scores into different combinationSp however, a total of 22 actual and 
alloyed values resulted. 

Educational Status of the Three Groups Compared 
The number of school grades completed was taken as an indication of 
the mental alertness of the individuals. Borne studies have been made 
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Visual Functions and Industrial Safety 

which inclicftte that the amount of schooling received is a fair index of 
general ability. It was regarded, tlierefore, as essential to hold education 
fairly constant, on the average, for the three groups. The Critical 
Ratios between llie three injury groups indicate that the average differ- 
ences in schooling received by those groups are not significant, ^ the 
Critical Ratios for tlie Accident-Free group as compared with the High- 
Frequency and the Serious-Injury group being .90 and .05, respectively. 
The Critical Ratio of the High-Frequency group when compared to 
Serious-Injury group was .82. 

Accident-Free vs. Serious-Injury 

Tlie data rovcai that the Ortho-Rater Means show a significant 
differcnco in favor of the Accident-Free group over the Serious-Injury 
group in the following visual functions: (a) Acuity — both eyes, far vision; 
(6) Acuity— right eye, far vision; (c) Acuity— left eye, far; {d) Acuity- 
bettor eye, far; and (e) Acuity— worse eye, far. 

When seven of the visual tests in the Ortho-Rater were combined a 
highly significant difference resulted between the Mean scores of Accident- 
Free employees and Serious-Injury scores, the Critical Ratio being 2,69. 

Accident-Free vs. High-Frequency 

Critical ratios exceeded the criterion when the Accidcnt-Frce group 
was com[)arecl with the High-Frequency group on the following test data: 
(a) Acuity— right eye, far; (b) Acuity — left eye, far; (c) Acuity — better 
eye, far; (d) Acuity — worse eye, far; and (e) Depth. 

Special mention should be made of the Critical Ratio of 1.99 of 
Lateral Phoria, — near subtracted from far. Since this Critical Ratio is 
only .04 below the criterion, a definite trend is unquestionably indicated 
here. 

The combined total of seven visual tests indicates a highly significant 
difference between the Mean scores of the Accident-Free and of the High- 
Frequency group, the Critical Ratio being 5.44. 

High-Frequency vs. Serious-Injury 

Not a single Critical Ratio meets the criterion (2.03) for significant 
difference between these two groups. Tliese findings are what one should 
naturally expect, provided the personnel for these experimental groups 
were ])ro]mrly evaluated. It is generally agreed among authorities in the 
field tliat a High-Frequency case is a potentially Serious-Accident case; 
so, the present Scrioiis-Accidcni individual is, in many cases, the previous 
High-Frequency individual. This thesis is important in tlio prediction 

* J. P. Guilford, Psychometric methods. New Yorki McGraw-Iliil Book Compaiiyj 
Inc., 1930, 548-549. A value of 2,03 is the criterion selected for significance. 
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of {lie evciiiiual Serious-Injury iiidivitlnul on llieljiisiH of IIiKli-I''rcqiiency. 
This fact is further Hubstiintiated l)y the low (hiticdl Katin, when ii com- 
posite of seven visual scores was studied hetween the IliKh-Freduoncy 
and Serious’liijury group. 

Of course, there arc some exceptions to tlie rnl(!. 'riicre niny he some 
persona who have serious accidents Imt who never have heen elnssificd as 
the liigh-Frctiueucy type. NevertUelcKSt tlie.ae. data auppoi li tlie, above 
thesis (piito well, 

Visual functions seem to ho nn iininu tnnt contvihutinf' factor for the 
safely of tlie inihistriftl worker, Obviou.sly, many factors enltir to make 
on employee an alwoliitcly .safe worker, hut vi.siml fiinelionH have only 
recently taken their place as being equally as iniporlunt as, if not more 
important than, other factois covered in the literature on safety. 

Summary 

(1) The Accident-Free group is significantly superior in visual 
functions to the Serious-Injury group and also to the Iligh-Frerpioucy 
group in the following: («) Acuity— right oy(* — far vision; (h) Acuity- 
left eye — far vision; (c) Acuity — bettor eyc3 — far; and (d) Acuity— worse 
eye — far. 

This points to conclusinnH similar to those reached in previou.s experi- 
ments reported by the writer.^ It Is well to note that the. Accident- 
Free group earned significantly higher scores in vi,suul performance (or 
the poorer eye than did the other two groups. 

(2) Acuity, Botli Eyes, Far Vision scores indicate tiio Aeoidont-Freo 
group to be superior to the Scrious-Accidcnt group, 

(3) Depth perception is present to a significantly liiglior dcgi'ce in 
the Accident-Free group than in the High-Frequency group. 

(4) In addition, there seems to he a trend in the direction of the 
visual functions and .safety; Lateral Phoria— Near subtracted from 
Lateral Phoria— Far. 

(5) When a composite of seven visual functions was made the Acci- 
dent-Free group was superior to the High- Frequency and Scriou,s-Iniui’y 
group, the Critical Ratios being 2.G9 and 5.44, respectively. 

Received December 7, 

* Visual funclionB iuh related to accidcnlrpvoncncftB. PcrGninic{, IQ'H, 21, 60-fiQ; 
Spotting tlio aQcidcnIrpiOftc workcra by viflual Fad. MgmL^ L03, 109 - 112 ; 
Visual /unctions and safety. Nal. Safely News^ 49, 22 iT. 



Effect of Visual Adaptation Upon Intensity of Illumination 
Preferred for Reading With Direct Lighting * 

Miles A, Tinker 

Umvertily of Minnesota 


A reader rarely hesitatea to express a preference for what he considers 
to be an adequate light intensity for easy and comfortable reading. 
Luckieah and Moss (4) claim that this subjective method of investigation 
yields both significant and interesting results. Although they admit that 
such results are not desirable for laying n scientific foundation for lighting, 
it is employed by them as corroborative evidence. In general, prefer- 
ences for illumination intensities have been employed for two purposes: 
(1) as supplementary data in prescribing foot-candle standards for reading 
and (2) to persuade consumers that a high level of light intensity is de- 
sirable. The validity of such practices may be questioned. In this paper 
the plan is to examine critically the evidence in the field and to present 
new experimental data on the validity of preferred intensities as a meas- 
ure of ease of seeing. 

Review of Previous Experiments 

In a study by. Luckieah and Moss (4), 82 subjects selected the intensity 
of illumination considered as ideal for an extended period of reading black 
print on white paper. The readers employed their own criteria of com- 
fort afforded by the lighting. Intensities from 10 to 1,000 foot-candles 
were available. Preferences were distributed as follows: 11 per cent at 
10 foot-candles, 18 at 20, 32 at 50, 20 at 100, 17 at 200, 1 at 500 and 1 at 
1,000. Although it is stated that the subjects chose an average of about 
100 foot-candles, the authors do not note that the median was at 50 in 
this atypical distribution. It is common statistical practice, of course, 
to use the median rather than the mean in atypical distributions. In 
another report (1) Luckieah states that many observers chose 370 foot- 
candles of illumination for comfortable reading. The readers viewed an 
illuminated page of a telephone directory through a small window in a 
black box. Nothing ig said concerning the visual adaptation of the sub- 
jects. Little confidence can be placed in this uncontrolled experiment. 

Several other experiments have been performed. Luckiesh, Taylor 

* Grateful acknowledgment is given to the Graduate School, University of Minnc- 
aota, for research grant to Gnance this study. 
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aiKl Sindcn (2), employing well distributed geuend illumination, fovnul 
that subjects prcfeircd on the average fooU-andles for rondiug 11 and 
12 poli\t type, and 10. G to 16. 1 fuot-eiuuUcs for 0 point. For iv low degree 
of contrast between 0 point type and printing H\iTface, 17.4 foot-candles 
\Ycre cbosen ^YWcn 30 were avnilaldo. In anotlun- ?it\uly witli well diffused 
gcncrnl ilbmination, L\ickiosh and Taylor (3) ol>taine(l preferonceH of 
illumination intensities for reading 9 ])()int typo. With ii]! to 8 foot- 
candles available, the readers cbo.^e 4.2; with 30, ID.O; with 43, 10.1; with 
05, 23.2; and with 100, 35.8. It was concluded that the readers did not 
choose the maximum hooauso they ]n*ohahly iissinned that the desired 
intensi ty was somewhere l)etwceii the extremes. This conclusion appears 
unwarranted since in the experiment cited aimvc (4), in which preferences 
were made solely upon the basis ol the reader's own criteria of comfort 
afToided by the lighting and witli no suggcstioii that one’s choice should 
avoid extremes, the median choice was only 50 foot-caiidlos. 

Why do such diflercnt choices appear when the rcjador exjircssos his 
preference for tlie illumination intensity best suited for comfortable 
reading? In the data cited above, there is asugge.stion that visual adapt- 
ation nt the time of the choice plays a dominant role in the choice. As 
the eyes are exposed to a greater range of hitoasities, j)ai tiul ada])tation 
to brighter illumination may oceiir and this can lend to a choice of more 
foot-candlcs for comfortable reading. It i.s well known that vision readily 
adapts to easy and efTicient seeing within a wide range of illumination 
intensities. To test tlio liypotliesis that visual adai)taiioii innuenccs the 
reader's preference for the illumination inteiiHity best for comfortable 
rending, an experiment was carried out by Tinker (0). There were 144 
readers tested. At one sitting a subject was adapted for 15 minutes to 
8 foot-candles intensity and then chose, by the paired comparison metliod, 
between 8 foot-candles and each of the following intcnsitic.s: 1, 2, 3, 5, 12, 
18, 26, and 41 foot-candle.s. There was a four minute rcadaptaiion to 
the 8 foot-candles before each succeeding choice. At the otlicr sitting, 
the subject was adapted to 52 foot-candlcs and then chose between 52 and 
each of the following inten.sUies: 18, 30, 41, 46, 59, 02, 71, and 100 foot- 
candles. When adapted to 8 foot-candles, 8 foot-candles was preferred 
moat frequently for easy and comfortable reading, hut the median wnis at 
L2 foot-candlcs. Similarly, when adapted to 52 foot^eiindlea, the median 
choice was for the intensity to \vl\ich the subiect was adapted. It seems 
clear that visual adaptation at the moment eletevmines to a large degree 
the intensity preferred for reading under general ilKimlnatimi. 

In a preliminary study of ilUiminatlon intensities prof erred for reading 
under direct lighting, Aasen, Bunvcll and Harmon (cited by Tinker, 7) 
obtained choices in a situation which approximated the light from the 
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old-fashioned type of bridge lamp. The reader explored over a range of 
from 1 to SO foot-candles. When progressing from lov^ to high intenai- 
ties, the mean choice was 21.5 foot-candles) from high to low intensities^ 
28.9 foot-candles. In a similar study of preferences of illumination in- 
tensities for reading, Tinker (7) employed metal shade, flexible arm read- 
ing lamps which yielded strictly local illumination. The mean intensity 
chosen by the readers was 42.6 foot-candles when 3 to 160 were available. 
Although visual adaptation was not adequately controlled in either of 
these experiments, there are indications that variation in adaptation was 
influencing the results. There is need for further experimentation in 
this kind of situation with strict control of visual adaptation. This is 
done in the following study. 

Description of Experiment 

The purpose of this experiment is to determine illumination intenai- 
bies preferred for easy and comfortable reading under strictly localized 
lighting when visual adaptation is controlled. The experiment was con- 
ducted in a light laboratory with no outside windows, hence rigid control 
of illumination was possible. Six standard, metal shade, flexible arm 
reading lamps equipped with regular frosted bulbs provided highly local- 
ized lighting. The fairly uniform spot of illumination on the reading 
stand was about 10 inches in diameter. From the perimeter of this area 
outward, the illumination decreased rapidly in intensity. 

Sixty university students served as subjects, There were two ses- 
sions of 50 minutes for each subject, At each session, the subject was 
adapted to a certain standard level of illumination intensity. At one 
sitting this level was 20 foot-candles; at the other, 50 foot-candles. Half 
of the subjects began with the 20 foot-candles, the other half with 50 foot- 
candles. 

The subjects observed one at a time. When a subject arrived at the 
laboratory, he spent 15 minutes adapting to the standard illumination 
(20 or 50 foot-candles). Near the end of this period, he was directed to 
do some sample reading of the printed material that was to be used in the 
experiment. This text (Winkler's Morgan the Magnificent) was printed 
in 11 point type with 2 point leading and a 23 pica line width on mat 
white paper. At the end of the 15 minute adaptation period the follow- 
ing directions were read to the subject: 

am going to ask you to decide which of several brightnesses of light 
you prefer for reading. Decide in terms of the light which, seems most 
comfortable for reading. You will be asked to read a few lines under a 
standard light- — the one now on — and then under a comparison light. 
After trying this for a couple of times, you will thoose which light you 
prefer for reading. Several lights will be compared with the standard. 
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Ten seconds after notifying the Bnbject that Iho light no^v on Avns one 
of the lights to be cojnpared, the standard was swildied olT and simultane- 
ously the comparison light was switched on. Ten seconds later the 
whole procedure was repeated and then a choice asked for by asking, 
yow prdev tUia ov thi«?'\ The subject was reada\itcd for 2 minuter 
to the standard intensity before the next choice. "J"he 20 foot-candle 
standard was compared with 4, 10, 50, 75 and iOO foot-candles in a 
random order. For every alternate subject the random order was 
different. The 50 foot-candle standard was compared with 4, 10, 20, 75 
and 100 foot-candles with a similar randomized prcsciilation. Thus each 
subject made five choices under each of Hie two condition.^ of adaptation. 

The illumination intensities were checked every day with a recently 
calibrated General Electric Foot-Candle Meter to be sure that ilie inten- 
sities were accurate as planned. 

Results 

The frequency with which each intensity was chosen as best for easy 
and comfortable reading was computed. Since the standard intensity 
was compared with cacli of the five other intensitie.s, it appeared five 
times ag often as each of the comparison lights. It was neccxssary, there- 
fore, to divide the frequency of choice for the 20 and for the 50 foot- 
candles by five to make these figures coiniiarablo with the others. The 
results, showing the.se adjusted data, are given in Table 1. In the first 

Table 1 

Illumination IntouBiUcs Preferred for Howling With Direct Lighlir)[:; 

Note: In top section of table, the 20 foot-candle light was compared separately with 
4, 10, 50, 76 and 100 loot-candlca. « GO university atudentvS. Under these contli- 
tlona, 4 foot-candiea/vere chosen 13 times (7 per cent) out of 184 cffeclive choices; 10 
foot-candlea, 13, etc. The bottom section of the table is read in a similar miinncr. 
Here Iho Btandnid waa 50 foot-cnndlea. 


Adapted to 20 Foot-candlcs 


Foot-candlcs ConipnrDd 

4 

10 

20 

50 

75 

100 

Choice frequency 

13 

13 

29 

40 

42 

41 

Percentage frequency 

7 

7 

IG 

25 

23 

22 



Adapted to 50 Foot-candles 


Poot-cnnclles Compared 

4 

10 

20 

50 

75 

100 

Choice frequency 

13 

13 

16 

37 

35 

37 

PercciitugG frequency 

G 

0 

11 

24 

23 

24 


row of each part of tho table are listed the intensities of illumination 
compared. Just below are given the frcqucnciea with which each inten- 
sity was chosen aa beat for easy and comfortable reading of the 11 point 
type. Percentage frequencies are listed in line three. In reading the 
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tabic it slioulrl he vcmcinbGrGd that each intensity wag compared with the 
one to wJiich the subject was adapted. 

Examination of the data reveals that visual adaptation at the moment 
fl^jpears to determine to some degree the choices made, but that it does 
not play the clominunt role found by Tinlcer (6) in the study employing 
general illuminaiion. For instance, when adapted to 20 foot-candles, 
thero were 29 choices (1(3 per cent) at 20 foot-candles. But when adapted 
to 50 foot-eandles, there were only 16 choices (11 per cent) at the 20 foot- 
candles level. Before adjuaUng the data by dividing by five, there were 
145 choices at 20 foot-candlea when adapted to that intensity, and 186 
clioicGs at 50 when adapted to the 50. 

Wlion adapted to either 20 or 50 foot-candles, choices ranged from 4 
to 100 foot-ciindles. But the dominant tendenc}'' in both sets of data is 
to prefer relatively bright illumination in this strictly local lighting situ- 
ation. Thus, 50, 75, 100 foot-candles were chosen most frequently ir- 
respective of the intensity to which the subject wag adapted. The 
tendency to choose relatively high intensities for reading under strictly 
localized light agrees with an earlier finding (7), 

This preference for relatively bright illumination for reading under 
strictly localized direct lighting has unfortunate implications for the 
hygiene of vision. It has been demonstrated that local direct lighting 
such aa employed in this experiment is unhygienic (5). A small spot of 
bright light surrounded by dimly illuminated areas and shadows iu the 
visual field provides a situation that rapidly produces visual fatigue. 
It is the lack of uniform distribution of illumination in the visual field 
that is bad. In a situation of this kind, the greater the intensity of 
illumination, the worse it becomes for visual work since the demarkation 
between the small bright area and the dimly illuminated surroundings 
becomes more pronounced. In fact, the subjects in the earlier experi- 
ment on direct lighting (7) were much disturbed by the uneven distribu- 
tion of. illumination in the visual field, especially when higher intensitiea 
were employed. Nevertheless the readers do choose the higher intensities 
under the direct lighting. 

Literature on the subject (5) points out that when local lighting is 
employed it should be supplemented by general illumination to avoid an 
undesirable degree of brightness contrast within the visual field. This 
liygienio principle is unlcnown to many and frequently ignored by others. 
It is of some importance, therefore, to point out that the undesirable 
features of such a situation are accentuated as the light intensity ia in- 
creased. Apparently, therefore, it ia unsafe to follow individual prefer- 
encea as to what seems to be the best intensity for comfortable reading 
with strictly local lighting. If such a light is used, relatively low intensi- 
ties produce less visual fatigue. 
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Sumnaary and Conclusions 

1. A survey of the literature reveals a wide range of intensities of 
illumination chosen as best for comfortable reading under general lighting. 
Visual adaptation at time of choice largely determines the intensity pre- 
ferred. 

2. The purpose in this experiment was to determine the effect of visual 
adaptation upon illumination intensities preferred tor reading under direct 
lighting that is strictly local. 

3. The illumination used was derived from standard metal shade, 
flexible arm reading desk lamps. Range of illumination available was 
from 4 to 100 foot-candles. 

4. Sixty subjects observed at two sittings. At one sitting they were 
adapted to 20 foot-candies; at the other, to 50 foot-candles. After 
adaptation, each subject chose between the standard to which he was 
adapted and each of five other intensities on the basis of the intensity pre- 
ferred for easy and comfortable reading, 

6. Visual adaptation at time of choice influenced the choice only 
moderately, 

6. There was a marked tendency to prefer intensities at and above 
the brightness to which the subject ^Yaa adapted, This resulted in fre- 
quent choice of high intensities, 

7. Since, in direct lighting such as used hero, bright intensities make 
a bad situation worse from the viewpoint of hygienic vision, preferences 
for illumination intensities for reading yield unsatisfactory data for pre- 
scribing lighting for the individual. 

Rec&ived November 22, t9/f4. 
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Mechanical Aptitudes of University Women 
Lillian G. Portenier 
The UniversilK Wyoming 

With wartime economy demands emphasizing the already existing 
educational and cultural needs for greater mechanical training for uni- 
versity women the Detroit Mechanical Aptitudes Examination was ad- 
ministered to four hundred twenty-five women students at the University 
of Wyoming during the winter quarter 1942-1943. The revised edition 
was used. The Detroit test was chosen since, according to the authors, 
many of the items appeal to girls making the test suitable for both sexes. 
The same set of norms i.s used for the two groups. The variation of only 
one to two per cent between the .sexes was not believed to be sufficient to 
warrant complete sets of separate norms. No appreciable difference 
could be detected in the median scores. 

The similarity in achievement for both sexes for the Detroit test 
differa markedly from the results found for the Stenqui.st Assembling 
Tost. Stenquist (8) reports that elementary school girls obtained only 
about 65 per cent os many correct items as boys, and that women in 
graduate school obtained about 80 per cent ns many correct items ag un- 
sehsted adult men. Similar clifierances were found in an extensive in- 
vestigation in which the Minnesota Mechanical Aptitude Tests (7) were 
used with seventh grade boys and girls, and sophomore men and women 
in the college of Science, Literature and Arts at the University of Minne- 
sota, The scores made by the university women were about the same as 
those made by seventh and eighth grade boys. The differences were 
most marked in a mechanical assembly test and in comprehensive tests 
of mechanical information. In general, the difference in males over the 
females increased somewhat in the older groups. 

At the present time the available data appear to be inadequate to 
indicate whether differences in mechanical aptitudes between sexes or 
between individuals within each sex are due primarily to differences in 
general ability or to a special ability or abilities. Freeman (5) states, 
“One may well question whether it is appropriate to speak of mechanical 
ability as dissociated from general ability, that is, as a special ability.'’ 
The results of the Detroit Mechanical Aptitudes Examination administ- 
ered to the women students at the University of Wyoming were analyzed 
largely for the purpose of throwing further light on this question. 
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Of the womeu tested 48 per cent were froshineiip 24 per cent fioplio- 
mores, 15 per cent juniors, and 13 per cent seniors. Tlicre are eight sub- 
teats in tlie Detroit Examination. Tests two and eight were designed to 
mensiiro Motor Ability; tests tliree, five, and seven, Visual Imagery; 
tests one and six, Mechanical Intormatiim, and lost four, Ariiiunetic. 
TJic “norms arc bused on ten thouHiind scores, cliiotly tlie unselcctcd 
groups of pupils at the eighth and niiitli grade levels in Detroit. How- 
ever, the examination has been given also to stnunal hurulrccl mciitally 
subnormal cJiildren, to some normal fifth mul sixtli grade pupils, and to 
small groups in the senior high school as high as the iwelftli gnulcT 

Table 1 

Mecliana, Means, Standard Deviations, Ability Ages and llalings for the Scores on tlio 
Detroit Mechanical Aptitudes Exnmiimlion, and the Ohio State 
University Test, for Uuivcraiiy Woinuu 


Teat 

Num- 

ber 

Me- 

dian 

Mean 

S.D. 

Arc 

llalings 

Detroit Mc^ihauical Apti- 
tudes 

Parti, Motor Ability 

425 

60.00 

59.80 

8.45 

10-3 

A, Very Superior 

(TcaU 2, 8) 

Partll, Viaiiftl Imagery 

425 

01.11 

85.25 

17.55 

17-2 

11, Superior 

(Teats 3, 6, 7) 

Part III, Mechanical 
Information 

425 

C0,20 

49.86 

8.85 

lfl-9 

n, Very Good 

(TcalB 1, e) 

Partly, Arithmetic 

426 

30.87 

.30.94 

0.30 

18-8 

B, Very Superior 

(Test 4) 

Total Scores 

425 

229.20 

225.08 

30.60 

17-5 

B+, Superior 

(Testa 1-8 inc.) 
O.S.U, Pflychobgical 
Partll, Analogies 

390 

30.5G 

31.00 

11.05 


53%ilc 

Total Scores 

390 

80.00 

80.25 

28.31 


55%ib 

(Parts I-IWII) 







Since the Ohio State UniverBity Psychological Test is adminialered to 
all students at Wyoming ns high sehool Honiors or after enrolling at the 
University the results of this test on file in the personnel dcpai'trneiit wore 
used as ft basis for determining the general mental ability of the women 
used in this study. The medians, meaiiH, standard doviatioiiK, mechan- 
ical ability ages and ratings for the scores on the subtcHLs and on the total 
teat for the Detroit Examination, and for Part II, analogies, and for the 
total score on 0. S. U. Test are shown in Table 1. The mean ])ercentile 
rank on. the 0. S. U. Test for the group is strong average on tlio basis of 
the national norms. In comjmrison with the norma for the Detroit Exam- 
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ination the median and mean scores were above average on all of the aub- 
testa and also for the total score on the test- The lowest mean a core was 
achieved on the tests which were designed to measure Mechanical InfoN 
mation and the highest score on the tests for Motor Ability. The mean 
score for Part IV, Arithmetic, also was very superior. As indicated by 
Table 2, 72.5 per cent of Lhc women earned superior scores on the mechan- 
ical aptitudes tests, and with the exception of but one woman the re- 
maining 27.5 per cent earned avei’agc scores. This group of women was 
above average in mental ability as well as in mechanical aptitudes and a 
definite relationship between the scores was evident. 

The superior results for this group of women may be due in part to 
the fact tliat the norma of the Detroit Examination are based chiefly on 
unselecfcecl groups of junior high school pupils. However, in no case did 

Table 2 


Pftting of 425 University Women on the Detroit Mechanical Aptitudes 
Examination and the O.S.U. Teat 



Hating on Detroit Meohanical Aptitude Teat 

Hating on 

O.S.U, Test 

Inferior 

Below 20%ilc 

Average 

20 to 80%ilG 

Superior 

80%ile and Above 

Superior 

80%ilc and Above 

0% 

.r% 

1S% 

Average 

20 bo 80%ile 

.2% 

20% 

65% 

Inferior 

Below 20%ile 

0% 

6.8% 

2.6% 


the test fail to measure the limit of ability on any of the sub testa sinoe 
none of the women earned perfect scores on any of them. 

To study further the relationship between the results on the tests far 
mechanical aptitudes and mental ability, product-moment correlations 
were computed between the scores on various testa and subtesta. These 
correlations are shown in Table 3. With the exception of the testa for 
mechanical information and motor ability the correlations found are 
higher than those found for most other similar studies in which compari- 
sons were made between mechanical aptitudes and general mental ability. 

Stenquist (8) reports a correlation of ,23 between the Stenqiiist 
Assembling Tests and a composite score from six verbal intelligence testa 
in a group of 267 seventh and eighth grade boys. The same correlation 
viz. ,23 was found in this stud}'' between the subtests for Motor Ability 
and the total 0. S. XJ. Test. The Stenquist Assembling Tests are far 
more mechanical in character than the Detroit tests. They are not of 
the paper and pencil type. They involve the construction of common 
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mccihfiiiical ol^jectn from i>a»’ls s\u'l\ as w niousr tviip, doov lock^ 

clothespin, and bicycU? boll. SiniMj a ooiTcltititni of indicates ii very 
Blight degree of rclatioiisliii) StoiKiuist onneliidc.s tIuiL nuM-hiuiioal aptitude 
secm.s to bo a special ability. A correlation of .bl wan ffuinrl hy Patci.son 
(7) for IQG juaior high Kchool boys botwceii I. (J/h o.stinialed from saeres 
on tl\(i OtiH lutcUigcivce Test and the scores <d»laiu<'d from a jneehamcal 
aptitude battery, comi)oscd exclusively of api)arainH or uuini])iilation 
teats, For the Minnc.solii raj)er Form Ihmnl Test, whicli is a i)ap(U’ and 
pencil teat of the ability to lianclle spatial relations, and a vocabulary 
test Anastasi (1) obtained a correlation of .07 for 225 male college sLudentg. 

The 0. S. U. Test and the Detroit Kxiuninatiou aiipcai to have mote 
in common than the tests in the {stiidic.s prst oiled. The higher correla- 
tions found may be attrilnitccl to the common inllucncc of the compre- 
hension of verbid directions, knowledge of words, and general facility 
with verbal material. This conclusion seems to be supported by the 


Tal)le 3 

Oorreialioiia llotwccn ScorcH on the Ohio StiiLc University Tost and the Detroit 
Meclianical Aptiliulcs Examination for University Women 


Detroit Mcchnnlcal Aptitudes 
Exfiminalion 

Total 

0. 3. U. Te,^L 

Part 11,0. S,tJ. 
Anamgba 

Pact I, Motor AMlity 

.23 d. .032 


IVrt. II, Vieufxl Imagery 

.42 .020 

.38 i .028 

Part III, Mechanical InCorwalion 

.00 rh ,033 


Part IV, ArLihuxetic 

A3 zh .026 

.40 .027 

Total Teat, Mcdmiiictvl Aptituclea 

,63 -Jz .024 

.47 i .024 


relatively higli correlations found between ecrtaiii subtests and the total 
of the Detroit Mechanical Aptitudes Examination and the total scores 
and Part II, Analogies, of the 0, S. U. Tests. Ah shown in Table 3 the 
conelatLon of the total 0. S, U. Test with Visual Imagery is .42, with 
Arithmetic ,43 and with total Mechanical Altitude scorcB ,53. Between 
Visual Imageiy and Analogies it is .38, Arithmetic; and Analogies .40 and 
between the total Detroit test and Analogies it is .47. The authors 
report a correlation of .65 between the Mechanical Aptitudes Examina- 
tioTi and the Detroit Advanced Intelligence Test, 

Part I of the 0. S. U. Test is largely a measure of vocalnilavy ; Part II, 
analogies, was designed to measure a combination of reasoning ability, 
spelling, capacity for logical associations and lcno\vlc<lgc of grammatical 
forms; and Part III is primarily a lest of ability to read diflicuit passages. 
Part II would seem to have most in common with the Detroit Examina- 
tion since little vocabulary is involved and none of the aubtesta call for 
ability to read difficult passages. 


Mechanical A'pUiydes of University Women 481 

The findings from the data presented in the present study tend to 
support Guilford^s (6) conclusion. He states, '^Strange aa it may appear, 
there Bccm to be no special abilities of speed, learning, musical talent or 
mechanical bent. Musical talent is very complex and so is me- 

chanical skill.'' Thus, while the correlations between verbal and numeri- 
cal tests generally have been found to be low a higher relationship may 
result when both testa involve similar abilities, such aa ability to follow 
tlirectiona as appears to be the case, to some extent, with certain subtests 
in the Detroit and Ohio testa, and to an even greater extent between the 
Detroit Advanced Intelligence Test and the Mechanical Aptitudes 
Examination. 

That mechanical aptitudes are a complex of skills and abilities rather 
than a unitary special ability ig further indicated in a study of '‘Sex 
differences in the understanding of mechanical problems" by Bennett and 
Cniikshauk (4). They found women slightly superior to men in testa of 
manual performance if dexterity is involved, and men clearly superior in 
tests of mechanical assembly, or if strength is needed. Again, the super- 
iority of men was not so marked in tests involving perception of spatial 
relations as the Minnesota Paper Form Board or the Minnesota Spatial 
Relations Test. Subtests 2 and 8, designated as tests of motor ability in 
the Detroit Examination, involve dexterity, and subtests 3, 5 and 7 
termed tests of visual imagery depend to some extent on the perception 
of spatial relations. Bennett and Cruikshank (3) state, "Testa which 
require speed and accuracy in simple perceptual discriminations and in 
simple motor tasks show slightly better scores for girls. In tests of 
strength, boys are superior. In more complicated perceptual and spatial 

tasks, boys also score higher. To a large extent there can be no 

doubt that the superiority of boys in tests of mechanical ability is a 
function of our present system where women are ordinarily not expected 
to deal with certain types of mechanical contrivances nor encouraged to 
do so. When it happens, as it does in a war period, that women are 
called upon to do some of these things, their performances are far more 
creditable than might have been expected." 

Just as an I.Q. derived from one battery of mental tests does not 
signify the same thing necessarily as an I.Q. from another battery so 
the scores resulting from different tests of mechanical ability may be 
indicative of widely varying aptitudes or skills. The results analyzed in 
this study seem to indicate that the mechanical abilities measured by the 
Detroit Mechanical Aptitudes Examination are not dissociated com- 
pletely from general college ability aa measured by the 0. S. U. Test when 
the abilities measured are those of university women. 
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Aptitude and Interest Patterns of Art Majors in a 
Liberal Arts College 

Dorothy M* Barrett 
UunUr College oj the City of WeuJ York 

Many students in college have difficulty in choosing a field of special^ 
Often young people who succeed in electing a field of flpeciali^flr 
tion later change their minds one or even several times. Even when 
they make decisiona and follow through with theni; students frecjiiently 
later regard their choices ag mistakea. Much energy and ability are 
wasted because students fail to find fields of study and work for which 
their aptitudes and interests suit them. 

This paper describes a study, part of a larger project, which was under- 
taken with the intention of trying to discover whether or not a group of 
juniors and seniors who were majoring in art in a liberal arts college could 
be differentiated by means of a battery of tests from a group of juniors 
and seniors majoring in other fields within the same institution. The 
study was undertaken with the assumption that a battenj of tests would 
be necessary to obtain satisfactory predictions inasmuch as success in an 
acndcinic or occupationa] fieJd is likely to depend upon a number of 
aptitudes and interests and not upon any single ability. 

If it proved possible to differentiate art majors from a group of control 
subjects by means of psychological tests, then it was proposed, after 
further checking the results, to use the battery of tests as diagnostic 
measures in advising underclassmen who consider art as a major but who, 
in spite of having been accepted by the art department, still feel uncertain 
about the wisdom of their choice. 

Psychologists who are concerned with the problems of the vocational 
and educational guidance of students in colleges of liberal arts may find 
something helpful in the results of this project. The critical scores 
obtained in this study may not be the best ones for another institution 
because tlie predictive value of any scores would differ for each institu- 
tion, depending upon the curriculum in which the test program is used, 
the number and types of sjiecializations offered, the admission and 
academic standards of the college and the kind of art training given. 
However, a report of the rcsiiltg on those tests which proved useful in 
identifying art majors may prove valuable to other workers faced with 
advisory problems. 
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Subjects 

In reaponse to a request for voluntecrSa forty fitudent.s m the art 
major and an equal number of upperclassmen specializing in other fieklB 
took the battery of tests- The art majors were students who, ns juniors 
and Beniora, had obtained satisfactory grades in thoir field of specializa- 
tion and were quite aatisfied with tlieir choice of art as a major. The 
control group represented juniors and seniors in other majors who also 
expressed aatistacUon with thclv fields of fipcciaUzation. Subjects in 
both groups were interested in the testa, having been advised that they 
could learn their scores at a future date. All Btudenta were girls, students 
in Hunter College of the City of New York. 

Tests ' 

The teats which were administered to both tlie art majors and the 
control subjects included Meier's Tost of Art Judgment (1940 revision), 
Strong^s Vocational Interest Blank for Women, the Study of Values, 
Series BB of the Revised Minnesota Paper Form Board and the Guil- 
fords' Prognostic Teat for Students in Design.^ 

Scores were available for all subjects for the Psychological ICxamina- 
tion of the American Council on Education, ndminiatered at tlic time of 
admission to college, For a conaidcrablc number in the group, records 
were available of the scores on Greene's Michigan Vocabulary Piofile 
Teat which had been administered shortly after a studeni’a admiaaion. 

Results on Meier Art Judgment Teat 

The distribution of test ecorea niado by the art majors on the Meier 
Art Judgment Test ovorlapa markedly with the distribution of acores for 
the control subjects. As a group, however, the students specializing in 
art make higher scores than do the control subjects. The average score 
for the art majors is 109 while the average for the control group is 103. 
Using Fisher's t-test for measuring the significance of the difYcrence in 
the means of independent small eamplea, t equals 2.C, indicating that the 
difference is significant at the 1% level. 

There are other more useful differences between the two groups, 
however. A study of the distribution of ungrouped scores resulted in the 
establishment of two critical scores- A xninlmuin score of 99 eliminates 
a fair number of control subjects while diacriminaiing against only two 
art majors. A score of 107 and over ainglea out a conaidcrablc proportion 

' The author is indebted to Misa Adclo Linker for nsaistnnco in flooring the lesis and 
to the Bureau of Educational and Vocational Guidance of Hunter College of Llio City 
of Kew York ior aponaoring thi.g study. 

* Guilford, J. P., and Guilford, R. B. A prognoatic teat for students in design. 
/. apvl Psitchol, 1031, 15. 336-34E. 
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of the art majors wJiilc iucliicling only a small number of the control 
group. Tliu.s, there arc three significant ranges of scores. 

Each sui)jcct in the experiment was classified in one of the three 
ra»gc.s of scores, according to whether her score was below 99, from 99 to 
lOG inclusive, or 107 and over. Figure 1 shows the results of such a 
classification. The number of control subjects in each range is indicated 
by the figures to tlic left of the line within the bar. The number of art 
nujors in the Hiiine range of scores is represented by the figures to the 
right of the line within the i)ar. Tire per cent at the left end of each bar 
is the porccritago which the control group represents of the total group 
scoring wiLljin tlic limits indicated. The per cent at the right of eoch 



per cent* Per cenir 

Control Jubjectj Art MeiJor5 

Fia. 1, Showing how many were control aubjects and how many were art majoTa 
of those RtucIcntH acoring within certain ranges of scorea on the Meier Art Judgment 
Test. 

bar ia the percentage which the art group represents of the total group 
scoring in that category. 

Reference to Figure 1 indicates that 11 subjects had scores below 99 
on the Meier Art Judgment Test. Of this group having low scores; 82% 
me control Hul>jocts and 18% ore art majors. Of the subjects haying 
scores from 90 to 106 inclusive; 70% are control subjects and 30% are 
art majors. On the other hand, of the subjects with scorea of 107 and 
over, only 22% arc control subjects while 78% are art majors. 

On the basis of this study, any student scoring up to and including 98 
on the Meier Art Judgment Test would have only 18 chances in 100 of 
being a successful and satisfied art major in Hunter College. If her 
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score is between 99 and 107, her chnnccH of l)cinp[ an art major in the eame 
institution are still only 30 in 100. However, if a student has a score of 
107 and over, lier chancen of bcine tin art major arc more than double, 
then being 78 in 100. 

Results on Vocational Intcrast Blank for AVomen 
The usual method to be followed in iittcmpting to dilTcrontiato be- 
tween the two groups iu this study would be to use only the, ratings for 
Artist on Strong's Vocational Interest Blank for Women, with the ex- 
pectation that there would be more high ratings for Artist among the art 
majors than among the subjects of the control group. However, the 
author believed that high scores on occupations other than Artist might 
show either a positive or possibly a negative relationship to success in art. 
In other words, a student with an average rating as an Artist and no 
higher ratings for other occupations might succeed in art, while a student 


Table 1 

Showing tho Dielribulion of Ihilingg for Artist on Slroiig'a 
Vocational Intorcflt Blank for Women 




llntingH 

(or Artiet 



C 


B B-h 

A 

Alt 

2 

2 2 

7 

IB 

Control Subjects 

0 

0 7 

7 C 

0 


with an average rating as an Artist but a higher rating in one or more 
other occupations might not be a person who would succeed in art. 

BecauBo, then, there was a possibility of finding certain additional 
relationships which might dificrentiatc between tlic two groups, the 
blanks were machine scored for all occupations. The writer studied 
carefully the distributions of letter grades for the art majors and for the 
control subjects for each of the 17 occupations on the test. The ratings 
for several of the occupations did differentiate between the two groups. 
It was concluded, however, that the additional ditTerentiation on the 
basis of the extra scores was insufficient to warrant, for fiitui e counseling 
services, the expense of the extra scoring rcciuired, Tlio remaining dis- 
cussion, therefore, is limited to a consideration of the scorcH for Artist. 

Tho art majors and the control subjects obtained rather different 
ratings for Artist. The tabulation of tlic letter I’atings for each group is 
given in Tabic 1. Reference to the table indicates that only six of the 
forty art majors scored B — or less as Artist while twenty-two of the con- 
trol subjects had such low ratings. Thirty-four of the art majors scored 
B or better, while only eighteen of the control subjects had such high 
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ratings. In other words, high scores for Artist on the Strong test are 
more often than not associated with successful specialization in art. 

Figure 2 sliows that a student’s chances, according to the results of 
this study, of l)cing a successful and satisfied art major are only 21 in 100 
if she has a rating of B - or less. If she rates B, B+ or A, her chances 
of being a satisfactory and satisfied art major become 65 in 100. 

Results on a Study of Values 

Keeping tlie control and cxjjerimcntal groups separate, a study wos 
made of the distributions of the scores for each value on the Allport and 
Vernon Test. 



100 80 60 40 20 0 10 40 60 80 100 
Per ceni" Per cent' 

Control Subjects Art Myori 


Pio, 2. Showing how many wore control Bubjects and how many were art majors 
of thoBO Btudenta Hcoring within certain ranges of ratings for Artist on tho Vooatiojia 
Interest Blank for Women. 

The art majors and control aubjects, while yielding overlapping dis- 
tributional did nevertheless show certain differences. Both groups had 
very high scores on tlie Aesthetic scale, but a greater number of the art 
majors scored at the cxticmo end of the scale than did the control sub- 
jects. More control subjects had extremely low scores on the Aesthetic 
value than did the art majors. Taking into consideration the relative 
number of art majorfl and control subjects at each end of the scale, a 
score of 46 and over was given a value of +2 and a score of 32 or less was 
assigned a weight of —3, In like fashion, weights were worked out for 
the other values on the lest. On the basis of these weights, it was the- 
oretically possible to iiave a total weighted score for the Study of Values 
varying from -17 to H-12. Actually, the scores varied between -13 
and +8. 
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A fitudy of tho dihlributioiiw of ihvi \v(Mjj;1ilrd i^voivs Uul lo the cwlab- 
liflhnienfc of ficirtain critical WTorcH w ide)* irnc ii>-:cd ta hcL up ninf(cs of 
acora that were siKiuficiuil. Tlic vUvnt fn wliich tlu* rxiuiriniciilal and 
control groups differed is inilieulod \\\ Figure 'd. 

A total of 25 aludeols luul srorcH li(*t\v(*eii — l;i tiiul —2. Of this 
groiipp 88% were control sui)j(!(ils imd only 12^?- were urt nnijors. On 
the other haiulp in the group having very high snort's of 1 luid cjvcr, 80% 
wore art majors and only M% wert^ eontrol suhjevls. 'The nuddle range 
of scores included more cqniil i)n)pi)rtionH of iirl nuijors and control sub- 
jects, the exact proportions being sliown in Figure 8. (The figures in- 
side the bar again indicate the iinmhcr of eases uiion wliieli the [mr cent is 
baaed.) 


Wei^itd Scoivs 
onjtudy of 
Values 

4 If over 


-Z to + 3 


-13 to -3 



100 80 60 40 10 0 10 40 60 80 100 


Per cent- Per cent 

Control Subjects Art Majors 


Fig. 3, Showing how many were control tiiihjccla and how many wcto art majors 
of those atudente scoring within certain ranges of tolifti weighted scores for the Study 
of Values. 


Weighted scores on the Allport and Vernon Teat differentiated well 
between the art majovfl and the control subjecta. On the basis of this 
test alone it is possible to give a fair estimate of a Btiident^s chances of 
being an art major. The average score for the art majors was -t-2 and 
for the control subjects it was —3. Again using the t for nmall samples, 
we find that the differGnee between the averages is Hignifieant at the 1% 
level. 

Eeaults on Revised Minnesota Paper Form Board 
Series BB of the Revised Minnesota Paper Form Board was included 
in the battery of tests administered to the subjects on the assumption 
that the ability measured might be one of the aptitudes contributing to 
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successful composition, ns well ag contributing to success in such special- 
ized courses in the art major ns drafting and lettering. 

TIic control and experimental groups had rather similar scores on this 
test of spatial relntion.s. The average score for the control subjects was 
43 and for the art major.s was 47, n dilTorence which is small but significant 
at the 5% level. y \.8 indicated in Figure 4, 79% of the group scoring 
below 41 were (iontrol Hubjccls, while only 21% of the group were art 
majors. At tlie other end of the distrihution, 72% of those students 
scoring 61 and over were art majors and only 28% were control subjects. 
The middle range of scores included approximately half art majors and 
half control mibicctH, 



Per cent Per cent 

Control 5ulJjcct5 Art M^ori 

Fia* 4. SliowInK how ninny were control aubjecta and how many were ait majora 
of llioflc a tu do Ola who Hcored within certain rangea of bcotcb on the Minnesota Paper 
Form Board. 

Extreme bcoios on the Revised Minnesota Paper Form Board test 
were eignificant in differentiating between art majors and control aubjecta. 
This teat gave resuita fiiiHicientiy diagnostic to be included ia a final 
battery of tOBta. 

IlesultR on Other Tests 

The experimental and control groups had identical Q, L, and Total 
acorca on the A. (J. E. Phycliological Examination. The two groups did 
differ, liowcvcr, on the Michigan Vocabulary Profile Teat. Analyas of 
the profile scoreH made ljy the ntudontH wlmn they were heshmen indi- 
catca that for the Fine Art.s Vocabulary acetion the average score for the 
students who later became art majors was higher than the average score 
of those students who later majored in other fields. Because scores were 





490 


Dorothy M. Harrell 


not available for all subjects, however, the test was not included as one 
of the predictive measures in the final battery of tests. 

The Guilforda^ Line Drawing Teat, which was inchiclcd in the experi- 
ment, brought out some interesting dilTcrcnGeg between the two groups. 
The test appeared to measure a certain creative ability whicli the other 
tests did not touch. However, the subjectivity of tlie scoring of the teat 
proved too great an objection to its use in practical circumstancoa. 

Eesults of Four Teats Combined 

The scores from Meicr'a Test of Art Judgment, Strong’s Vocational 
Interest Blank for Women, the Study of Values and the Revised Minne- 
sota Paper Form Board wore weighted in terms of the extent to which 
each test differentiated between art majors and control subjects. When 
the scores were combined, the results were strikingly satisfactory. 

The combined weighted scores ranged from —20 to +18. Dividing 
the subjects into two groups on the ba.sia of whether n given score was 
below zero on tlie one hand, or ^ero or above on tlic otlior liand, wc find 
that the control sul)jects are separated from tl\c art majors with 85% 
accuracy. The actual number of art majors and control subjects within 
each scoring range ia indicated in Table 2. 


Table 2 

Showing tho Diatribution of Total WciglUctl 
Scorca lor Test Battery 



ToLfil Wciglitcd Scores 

- 

20 to -1 

Oto +18 

Art Majors 

4 

30 

Conirol Siibjects 

32 

8 


Ordinarily, psychological testa pick out the failures more readily 
than the successes. A minimum score is often necessary for success. 
Not as often does a high score mean success. The tests used in this 
study have, however, tended to identify the art majors in positive fashion 
as well as to identify those students least likely to possess such a pattern 
of aptitude and interest. 

It should be pointed out that fiomc of the scores made by the art 
majors may be spuriously high. It is possil)le that the score.s on the test 
of Art Judgment and on the Revised Minnesota Paj)cr Form Board may 
be higher than would ordinarily be the case just because the studonts 
have been studying art. To w+at extent the differences established in 
this study would be substantiated if subjecta were given all testa at the 
beginning of their college courses is at present a matter of conjecture. 
The author is carrying out a study to check on this point. 
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Meanwhile, however, the diatribution of the combined scores war- 
rants further consideration. According to the results indicated in 
Figure 5, no art majors were included among the eighteen students having 
the lowest scores, the tests thus predicting 100% accurately for this 
range of scores. Eighty-five per cent of those Bubjects having high 
scores were art majors, a very satisfactory degree of differentiation be- 
tween the two groups. 

A study of the 6ve control subjects included in the range of scores 
which was generally typical of art majors leads the writer to wonder if 
the tests may not be even more successful than the figures have indicated. 
Reference to interview notes jotted down at the time the subjects took 



100 80 60 AO 10 0 20, 40 60 flO lOD 

Per cent Per cent 

Control Subjects Art AAyors 


Jig. B. Showing how many were control aubjccta and how many were art majors 
of those students scoring within certain ranges of composite weighted scores on the 
test battery, 

the tests or reported for their scores shows that one control subject who 
scored high on the battery of tests was an art major originally, but 
changed to another field because of a personal experience which had turned 
her against the study of art. It seems fair to conclude that she had 
reacted against personal! ties and not against art as a major. This girl 
was evidently not a fair control subject if what we are trying to predict 
is interest and ability in the field of art. 

Another control subject just recently discovered a flair for art. She 
is continuing her present major but has decided to include as many art 
courses as possible in her program. Very probably she would have made 
a sfttififftctoiy art major if she had become aware of her aptitudes and 
interests earlier. 
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A careful atudy of the (iplitude nntj inloicet ])iitterti.s of Hcvcral of the 
art Btudenta who fell outKide of their Kroufi on the baHW of the total 
weighted ecoreson tin's Imttory of t<;sls louds the tmlhor to conclude that 
nlthougli Iho students arc satisfied with their majors, they might have 
done better work and been better fintisfied in other fields. For exiimplo, 
one art major seems to have a flair for Rcieiice, a fuel which she never 
rcftUied awl never followed vi\i. It in possible, that it is siguificant that 
this student had scores more similar to the HCores of the control subjects 
than to tliG scores of the art majors. 

In conclusion, then, it can be stated that the total weighted scores on 
thia battery of tests diffcrcnlialcd clearly between the art majors and the 
control group. The difference between the averages of the two groups 
for the total weighted score is significant at the 1% level. 

Summary 

1. A battery of tests which included Meier’s Tost of Art Judgment, 
Strong's Vocational Interest Blank for Women, the Study of Values and 
the Revised Minnesota Paper Form Iloar<I difTcientiatcd between n 
group of 40 art majors and a group of 40 control subjects witli 85% ac- 
curacy. Critical 6core.s C8tabli.shcd for each lost made it po.s-sible to 
combine the results of the four testa and tlion to predict with only a small 
margin of error a student’s likelihood of being an art major in the curricu- 
lum of Hunter College of the City of New York. 

2. Other testa stud'ied but not included in the final Ijattcry of tests 
included Greene’s Michigan Vocabulary Profile ’Peat, the Guilfords’ 
Prognostic Teat for Students in Design and the A. C. 15. Psychological 
Examination. 

3, No differences were found between the control and experimental 
groups for either the Q, L, or Total scores on the Psychological Examina- 
tion. On the Michigan Vocabulary Profile Test, which had been ad- 
ministered to many of the students nt the time of their entrance to college, 
the art majors ranked higher than the control subjeeta on the Fine Arts 
Vocabulary section. Becauee scores were not available, however, for all 
80 subjects, the test was not included in the final battery of tests for 
which a weighted total was obtained. 

4, The Guilfords’ Line Drawing Test was administered to all sul)- 
jeefcs. A kind of oreativo ability Bcoraed evident in the data, nuggesting 
interesting possibilities for further analyHis. However, cvnluntion of tho 
records for this test is too subjective at this stage to warrant tho inclusion 
of the test in a battery of testa for immediate practical use. 

Received November SB, 11)44, 



Merit Examination Cut-Offs and Weights 

Wm. Thos. Toolan 

Stivervisor of Uecruiimenl, Los Angeles City Board of Education 

Altliougli the Merit System has made much progress during the last 
few years, it still faces tlie problem of shaking off some of its inheritances 
aucJi ns setting weights and passing marks in advance of examinations, 
and making cut-offs without careful study, Some public personnel 
agencies are compelled to arbitrarily set weights ahead of examinations 
because of the limitations imposed upon them by the laws under which 
they operate; other agencies accept this sort of procedure because others 
use it. The procedures set forth in this article will be found to be fairly 
objective because of the use of simple analysis and study of parts of exam- 
inations and their relation to each other. 

A “cut-off," for the purpose of this article, is a line on a frequency 
distribution of scores below which scores are considered as not acceptable 
or are below a predetermined standard. The lower tail of the distribu- 
tion is usually cut off. The upper tail represents persons supposedly 
“too good" for the particular job. This upper tail is not considered when 
making cut-offs in public service. 

The reason for these eliminations is not always understood by the job 
seeker. Most of them feci that they are qualified and therefore should 
be on the employment list. The recruitment office, of course, has defi- 
nite reasons for making an elimination after each part of an examination, 
and just before the eligible list is established. 

Applicants are not always told the real reason why their names do not 
appear on the list. They are often told that “the size of the list did not 
warrant placing their names upon it.” This would imply that “the size 
of the list is based on our anticipated needs," No matter how a notifica- 
tion of standing, that tells the applicant his name is not on the list, is 
worded, it means to him that he lias failed in the examination. This 
generally makc.s for ill feeling with the public. 

Elimination at each atop of the examination is ordinarily done for the 
purpose of getting rid of unlit applicants. The final elimination should 
be made on the basis of including all qualified applicants. That is, no 
matter what the needs or anticipated needs might be, all qualified ap- 
plicants should appear on the eligible list, The excuse of the recruitment 
or assignment office that it entails some additional clerical work hardly 
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aeema sufficient. For the flake of public rclationa, it is well that elimina- 
tion of applicants seeking jobs in the public service be done more carefully 
and scientifically than heretofore. 

Before starting to make a cut-olT, it would seem that a knowledge of 
what had taken place to give m these scores in the distribution would be 
a sine gua non. If we have not formulated the specifications, drawn up 
the test, administered or analyzed it, we should get in touch with those 
who have done so. We arc now qualified to take the first step in making 
tlie cut-off, This tentative cut-off will be a guess, backed uj) l^y the sup- 
porting data which we have at hand, 

A Tentative Cut-Off 

Around, or aomewlmt above and below this tentative cut-ofi, will be 
found test papers none of which are exactly alike. If the test is a written 
one or a practical (performance), the results for each candidate will be 
different although they may have the same score. One will have missed 
items which the other or others will have gotten right. If we have made 
too low a cut-off, we will be in the midst of a lot of poor papers. If we 
have made too high a cut-off, the papers will, generally speaking, be 
quite acceptable. Thus, we may have to move up or down and make 
several test cut-offs before wc arrive at a place where we are fairly sure 
that wc have neither done any great injustice nor included Any obviously 
unfit papers. 

If there are many vacancies or anticipated vacaticica tuid there is a 
dearth of applicants, we may be forced to include more alcove the cut-off 
than we would otherwise. Or, if there are few vacancies, or anticipated 
vacancies, we will probably not want to carry an excessive number 
through the remaining parts of the examination. There is great danger 
in picking up the unqualified when making a low cut-off, and there is 
danger in building ill feeling by failing a large group of qualified persona 
when making an unnecessarily high cut-off. 

A Typical Example 

What one runs into can be seen by examining a group of practical 
papers for say stenographers. . Among some obviously unfit papers is 
found a paper which on close examination shows that the contestant did 
very poorly at the beginning of the test and gradually got better toward 
the end in spite of the fact that there was an increase in words per minute. 
This was not due to lack of '%arm-up^' as wc find that ample practice 
dictation was given prior to taking the test. To those who are experi- 
enced in giving stenographic tests, these thoughts would immediately 
come to mind: Taking in shorthand and transcribing are different steps. 
The longer the test, the greater the possibility of the first part of the notes 
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getting cold. The testee who lacks a vocabulary of sign words or lacks 
retention will not be able to read much of the first part of her notes be- 
causQ they are colder. No matter how fast one can take shorthand) if 
she cannot transcribe or read her notea when they are cold, they are of 
little value to anyone. 

Many limitations are imposed on one who is attempting to make a 
scientific cut-off for a practical teat. It is impossible to assume a purely 
objective attitude. Persons scoring typing or stenographic tests do not 
rate exactly the same, Testees often make the same eri'or but under 
different circumstances. One stenographic testee omits five words of 
dictation and patching it up submits an acceptable letter, another makes 
the same error but makes no attempt to ''fill in.*^ They are penalized 
alikc- 

Although approximately the same modus operandi may be used in 
making cut-offs, no two are made in exactly the same manner. The 
more we study the peculiarities of the papers, whether written or practical, 
the more we are in doubt regarding the manner in which this or that 
answer was chosen in an item of a written test, or just why this otherwise 
good practical teat was spoiled by the testee doing something unusual or 
out of the ordinary. 

Ordinarily an examination includes a written and an oral part. 
Sometimes a practical test follows the written, and occasionally a practi- 
cal and oral is used. This last combination ia used where the practical 
is broad enough to test for the degree of skill needed for the job. How- 
ever, where it is necessary to test for technical knowledge, a written test 
is used. The oral test is ordinarily used as a test of general fitness for the 
job. It includes evaluation of personal characteristics, and education 
and experience, 

When Parts Should be Weighted 

The weighting of parts of an examination before it ia held can hardly 
be anything other than an estimate of the results of the examination. 
For instance; the written is compiled and intended to test for certain 
things, but after it ia administered, and the results thereof studied, it is 
found that it has failed to come up to expectations. The distribution of 
scores may show clearly that it is too easy or too difficult for the group, 
This would, then, make a difference in the weight assigned it. Ineffective 
rating on the part of oral or practical teat raters should be cause for 
lowering the weights of these parts, whereas otherwise they would be 
assigned higher weights. 

Where an agency uses the same written and other parts of an exam- 
ination, and the same rater requirements, and the quality of the applicants 
remain the same, about the same results can be expected. This being 
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the case tentative weights may be sat subjeefc to study after all jjarts ot 
the examination have been completed. 

The weight of an examination part will vary when studied in the light 
of the requirementg for the job. Kxami)lc.s of extremes, say for personal 
characteristica rcquircmeiiLs, would be 'Wretury” and ''billing niachine 
operator.^' Although studies have shown that the majority of emidoycca 
are unsatisfactory because of personal olinracteristics, wo must admit 
that the degree to which personal charaoteriatics arc inqiortiuit will vary 
with the job. Thus weights for the irarts of an cxiiiniiiatiou will depend 
upon the nature of the position for which the examination is given. 

The question as to the effectiveness of a part in an examination prob- 
ably is the least objective step in determining its weight. All considora- 
tions of the examination are kept in mind and the paired comparison 
method of ranking employed, In other words, this plmsc of the study 
presupposes n thorough knowledge of all that lias any bearing or throws 
any light on the examinations. It ia backed up by applicable informa- 
tion, or supporting evidence. 

If the written test has been administered and studied as to reliability, 
it can be relied upon to give about the same results each time it is used, 
provided the requirements for admission to the test have not been changed 
materially. Tlie practical is probably the easiest of all the j)arlg of an 
examination to size up as to its cfloctivencss, dej)cnding, of course, upon 
tlie raters, the nature of the test, how elaborate it is, etc. In all parts of 
an examination, with the exception of the written, evaluation of clTective- 
ness is based on observation, and, of course, distribution of acoro.s. 

As soon aa we affix n weight to a part of an examination we indicate 
that it has been considered in relation to the other part or parts of the 
examination. Its importance or effectiveness, then, is reflected in the 
weight assigned it. When an attempt ia made to consider n part without 
first conaidci’ing the other parts, the other parts may be left with too 
small or too large weights. That is to say, if we insist that written parts 
have low weights affixed to them, we are apt to find that the oral inter- 
view parts have been given exces.sive weights. 

What Weights Do 

If a part of an examination is im])ortant or effective, it should be 
weighted accordingly. When a part has jirovcn itself worthy of the 
heaviest weight in an examination, and auoh n weight has been assigned 
it, it becomes the controlling factor of the relative placement of poi'sons 
in the final distribution, or the eligible list. Thus the grealc.‘ 5 t weight in 
an examination will tend to move persona on the final distribution a 
greater number of places than will the smallest weight assigned. What 
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weights will do can be brought home most effectively by reversing as- 
signed weights and observing the results. 

Frequency distributions of parts of examinations vary to the extent 
tliflt no two are idoniical. This means, then, that their spreads and 
"forms” are instrumental in shaping final distributions and eligible 
lists. A distribution of a part which has a tendency to be bunched 
(skewed) upward or downward or for any reason does not have a good 
spread of scores 1ms set a comparatively low weight for its part, and should 
be weighted accordingly irrespective of what weight has previously been 
forecast for it. 

The setting of weights for examinations in other than a careful man- 
ner is apt to spoil everything that has gone before. Such a •prim methods 
as are sometimes used because of carelessness or ignorance of a few simple 
rules, are not in accordance with the merit system because they have a 
tendency to place persons on eligible lists out of the order of their relative 
excellence. This is true of any procedure which is not done in the 
manner in which it should be done. The results not being apparent to 
the layman he does not challenge the methods employed. 


Received October lO/i/f, 
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RosenstGin, J, L. The ficientific adedion of mlrmen. Now York: 
McGiaw-IIili, 1944. Pj). xii -f- 2r)l). 

The audience for, and major objeclive of, lliin Ixiok Ih utatod as follow.^ 
by tlie aiilhor: "This book is for .stilo.H cXeculivo.s wlio me lonR-range 
minded- Its purpose i.s to dc-soiilic, to explain, mid to touch the steps in 
a scientific salesman selection irrogrmn'’ (ix). Tor many reasons the 
publication fails by a wide margin to meet cither the need.s of its intended 
audience or its primary objectives. 

Throughout the book tlierc arc evidences of hasty, supeificial writing. 
Important concept.? arc ignored or treated .so sketchily that they might 
better have been ignored. On the other hand, certnin simjile ideas, such 
aa the computation of an average, arc heavily hvlrorcd. Part of the 
difficulty encountered by the author arises from hi.s attem))t to over- 
simplify psychological tools and lcchinque.s which just cannot ho so 
treated for lay readers. An example of this is the atUnnpt to tonch inter- 
pretation of complex psycliographs to laymen in fewer thim forty (iiiges 
(211-244), In the section on interviewing, such terms as "substitution," 
"persecution,’’ and "projection’’ arc introduced willi little cxi)lanation 
for naive I'eadcrs, 

Treatment of teshs and testing is entirely inadequate, Two quota- 
tions suffice to indicate the gcnernl approach to ineaHurcmcnt, 

"Do not be troubled nl)out the matter of adininiHtering te.sts. The 
instructions for each test are simple and, if followed caitdiilly, should 
present no difficulty’’ (169). . . /'Tests fur Basic InlmsLs. For an in- 
vestigation into the kinds of activitie.9 in which an individual is interested, 
one of the best known tests is the Preference llecord, by G. Tredcric 
ICuder. 

“Preferences will certainly be exhibited in tlic degree of entliusia-sm 
with wliicli an individual enters into various activities. It may be wise 
to learn the preferences displaj’^cd by your successful salcsimm as com- 
pared with those who fail’’ (167-68). This last cpiotation is the complete 
information given the reader about a test which is recoininciulcd for a 
selection battery 1 

Sections of the book are devoted to the application blank, and selection 
of salesmen for small companies. Mhlerials conceriiod with the a]j])lica- 
tion blank are the strongest point in the publication. Even in this section 
much of importance is ignored. Readers who wish to read further about 
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topics which interest them will be irritated by the author's failure to 
include sources. The names of writers and researchers are referred to, 
but the publications and publishers are omitted. 

In the opinion of the reviewer, this is a poor book on a topic which is 
deserving of much better treatment. 

_ rr . . Milton E. Hahn 

(Syracuse Umvemty 

Traxlei, Arthur E. Techniques of guidance: Tests^ records, and counseling 

in a guidance 'program. New York: Harper & Brothers, 1945. Pp. 

xiv + 394. 83.50. 

The first thirty or forty pages of this compact volume may give the 
reader, sophisticated or otherwise, some blank misgivings. But if he 
persists, his patience will be richly rewarded. Few books that have come 
to my attention in recent years have been more appropriately titled or 
more effective in their progression. From a conventional beginning that 
toys with definition, staff organization^ and costs, the science of guidance 
gradually becomes the art of bringing into conjunction to their mutual 
advantage the potentialities of pupils and the resources of school and 
community. 

School and community resources are treated rather generally but with 
ample reference to sources of information. Understandably the curricu- 
lum, which is the school's chief formalized resource, is neither described 
nor challenged; but the growth of the extracurriculum is given subtle but 
effective emphasis as a promising adjunct to readin', writin', and 'rith 
metic. 

If facta are the beginning of wisdom, then facts about the pupil — as a 
learnei’, a personality, and asocial being — are the sine qua non of guidance. 
Kinds of appropriate facts are outlined: home background, school history, 
mental ability, achievement and growth in fields of study, health, out-of- 
school experience, interests, special aptitudes, personality, and plans for 
the future. Use of the questionnaire and the interview is discussed and 
their values and limitations highlighted. 

Tests as instruments of fact finding, however, are given the largest 
amount of space and the most exhaustive treatment. Aptitude as a 
concept is intelligently discussed, and likewise the fact of individual 
differences; but without any attempt at explaining the why. A selected 
but reasonably exhaustive list of tests carefully and fully annotated is 
attached j including titles^ authors^ publishers, research information and 
references. 

An even more extensive array of achievement tests is described with 
equal fidelity to fact. These fall mainly within the areas of reading. 
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general achievement, English, foreign language, nmtlicmatics, Hcicnce, 
and the social studies. 

Appraisal of personality is treated under two headings: (1) tests, with 
a rather extensive annotated list included, and (2) anecdotal records and 
behavior descriptions nccoinpaiiied with discussions of the values and 
pitfalla of both tests and records or dcRcrii)ti()ns, 

planning and administering a testing [)rograin and H(!oi'ing, organizings 
and reporting test results arc fully and eneebively treated with concrete 
QuggestionB drawn from actual practice buttressing the general discussion. 

A variety of services and possible cooperative ventures are pointed out for 
schools not fully equipped to engineer a program without outside help. 

The possible uses of test results point up flliar|)ly the tremendous lag 
between test constrviction and test-giving ou the one baud, ivud on the 
otliei', what is done about all this fury of activity. With infinite patience 
Dr, Traxler dcscribe.g the instructional uses of tests. He elaborates them 
ao fully and with auch reasoned precision that he may feci, as many 
readers will, that he has argued his case perceptibly beyond the point of 
diminishing returns. Administrative use.s of teat results, and by infer- 
ence, their possible effect upon the curriculum, are it appears ^'outside 
the acope^^ of his book, 

Within the conventional sotting of school rcsourco.s, couiiRcliug uses 
of test results are recommended to identify individual weakncasca of 
pupils, to discover special abilities, and as a basis for conferences on be- 
havior adjuBtmenta, course setiuencea, vocational and educational plan- 
ning, But tests are only one element in the total guidance progi'am. 

comprehensivo and detailed system of cumulative personnel re- 
cords is indispensable for the proper functioning of the modern school,^' 
Some eighty pages of text and sample forms arc devoted to the cumulative 
record and reporting devices and to dependence on facts of status and 
progress for immediate or ultimate attainment of desirable educational 
or career objectives. The ideal ia admirable and convincingly presented 
as within the realm of the attainable. Comparability of test data is pro- 
jected ag essential. Adequate and systematically planned asacmbling 
and recording of other kinds of data are stressed as equally important. 
If both kinds of information are to bo significantly useful, they iniisb take 
their origin not from teats and records as such but from '^a stiidy of the 
nature and purposes of the school and of the pupil. Useful, x)ractical 
suggestions are given for filing and accessibility of materiala. 

'^The whole thesis of this book, however, is that counselors who are 
not psychologists are entirely capable of performing the distrihulive 
functions of guidance and many of the Cess involved adjustive fundionsj 
provided they will get acquainted with and use the techniques for know- 
ing individuals/^ To this end lists of Teferencee, not exhaustive, but 



Book Reviews 


501 


well chosen, Imvc been appended to each chapter; and the final chapter 
consists of reading resources for counselors. For those who have the 
urge to learn their students ns well as teach them, Dr. Traxler’s volume 
liolds out great i)romise. For those who are professionals in the field of 
guidance, the volume is an excellent handbook. 

Tr_ S T^ppr.Q 

iSocial SeenriLy lioardf 
Washinglon^ J). C. 

Scott, Dorothy D., Morgan, Winona L., and Lehman, Ruth T. De- 

velo'piiig a sCiulcnl guidixuce 'progro^iri in an iusiruclioual departmeui. 
The Bureau of Educational Research, Ohio State University. 1945. 

65 pages. 

The monogra])li describes the procedures used for the past several 
years in the School of Home Economics at Ohio State University in an 
attempt to provide more adequate student guidance and to determine 
techniques uBctul to the teacher counselor. The plan was inaugurated 
because it had been found that many students graduated without any 
faculty member really knowing them, and many made unsatisfactory 
vocational choices. 

The staff ncce])tcd the idea that colleges eliould be concerned for the 
all-round development of the students, that the guidance point of view 
should permeate student-faculty relations, and that the college staff can 
beat acquire this through participating in a guidance program. 

Responsibility for guidance is divided among three groups. The two 
coordinators are chiefly concerned with administration although they do 
some counseling and teaching; the general advisers z-etain the same ad- 
visees throughout their four years in college, hold planned conferences 
with each of them (and additional conferences upon request) to analyse 
(the atudentsO progress, plan next steps, and suggest resourcea for their 
personal development; and the professional advisers plan policies for 
selecting students, provide group guidance on professional problems and 
assist in placement. Most faculty members serve as general advisers 
and the heads of departments as professional advisers. 

Individual Cowu&eling, Each conference with the general adviser is 
planned with a specific purpose, although plans may be altered if desired. 
The chief idea is to help students and faculty to get acquainted and to put 
students in touch with sources of special help which may be needed, such 
as the Health Service, the Employment Service, and the Psychological 
Clinic. The first conference is held during Freshman Week, the second 
in the spring. The sophomore conference comes in the middle of the 
year and is planned to offer help in making a vocational choice. The 
lost planned conference is arranged for the fall of the junior year and at 
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that time students are helped to analyze what has been nccompliahed 
during the first two years and what should be planned for in the last two 
in order to get the maximum out of college. Students may initiate 
conferences during the senior year as they may during the preceding 
years^ but no definite conference is scheduled. Informal entertaining of 
small groups in her office or at the adviser's home provide.s a very worth 
while type of contact. 

Transfers are assigned to advisers when they cuter and they furnish 
much of the same personnel information which the frc.shmen do. 

Group Guidance. Several types of group guidance are offered. The 
Freshman Orientation course which \h required of all entering freshmen, 
meets three times a week, and carries two credits. TJic course includes 
small group discussions for 30 or 40 students, counseling by instructors 
and selected older students, collection of personnel information, and ad- 
ministration of moat of the tests used. Professional guidance is given 
through meetings sponsored by professional advisers — sometimes for 
those specializing in the department and sometimes open to all students. 
Discussion of pertinent material, student participation in the program, 
and recognition on the part of the students of the need for the information 
probably explain the high attendance at these meetings. 

The Guidance Office is under the direction of the coordinatorg and 
handles much of the routine work of the program, such ns providing 
advisers with all needed forms, keeping confidential folders up to date, 
and administering tests. The coordinators take charge of scheduling 
laboratories for underclass students and the professional advisers of those 
for upperclass students, and in these, students work out their schedules 
and can obtain individual assistance if it is needed. 

Rating of students is done by staff members with n relatively simple 
form and provision is also made for recording any comments instructors 
wish to make about the student. Ratings arc given on only those points 
for which the instructor believes she has a basis for judgment and students 
are allowed to see their ratings when an adviser is available to help them 
interpret them. Careful self-evaluation is provided for at several stages. 

The appendix includes copies of all of the forms used in the guidance 
program, an outline of the orientation course, and an annotated list of the 
tests and inventories used . 

Clara M. Brawn 

Univenity of Minnesota 

Klein, D. B, Mental hygiene^ the psychology of personal adjustment. 

Henry Holt, 1944, xiii + 489. 

Mental hygiene hag reached the stage where specialists in the field 
should be factual, critical, and systematic. In the first major section of 
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the text, Dr. Klein fulfills excellently his preface promise to meet these 
criteria. Here, he discusses in some detail with documentation an ob- 
jective and eclectic view of the psychoses and paychoneuroses and the 
prophylaxis pertinent to each of them. The author^s second division of 
the field, called by him 'Tromotion of Mental Health,” is presented in the 
form of loosely connected essays^ moatly on important but eelected topics. 
The home, conscience, motivation, coping with reality, repression, econo- 
mic barriers, and education are the subjects of the chapters of this section. 
Despite the fact that there is a voluminous literature on parent-child 
relationships, only two references appear in the entire chapter on the 
home. The chapter on education deals with selected important problems 
but the reader may leave it without realizing the extensive factors in 
education affecting morale. The influences of the playground, athletics, 
cliques, and other extracurricular events, for example, are omitted. 

The author warns that he will restrict himself 'To the confines of 
mental hygiene territory.” This apparently explains the omission of a 
concise preliminary review of basic psychological concepts as motivation, 
adjustment, conditioning, inhibition, symbolism, etc., and fundament fils 
in a theory of personality. It does not explain why psychoses and pay- 
choneuroses are given a disproportionate emphasis at the expense of 
juvenile delinquency, child and adolescent personality and beh^tvior 
problems and psychosomatic difficulties. 

Dr. IClein^a book makes certain distinct contributions to the field. The 
discussion of specific prophylaxis for each mental abnormality ia an 
example. The forceful chapter devoted to the economic and social 
aspects of mental hygiene reminds us that there are factors of social 
control in mental health which are outside of the influence of individual 
psychologists or psychiatrists. The recent periodical literature is related 
to a discussion of basic theoretical problems, such as the distribution of 
mental illness, the extent to which it is constitutional or the result of 
conflict, the implication of the animal studies and the meliorative and 
prophylatic roles of the hygienist. These are a reminder that too much 
has been written in this field without first examining basic premises, as 
Dr. Klein did. 

The task of meliorative mental hygiene as the author sees it is to 
develop a philosophy of life and high morale. This is not achieved, he 
stresses, through an array of mental hygiene maxims or drills. This 
emphasis is a good antidote for some kinds of pseudo mental hygiene. 
It is congruent with the prevalent non-directive trend in psychotherapy. 
However, discussion of specific problems and techniques as a means of 
eliciting insights and building attitudes in youth can be achieved by a 
skillful presentation without jeopardizing the reader's self direction or 
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independence of notion. This reviewer holioveH Dr. Klein could have 
strengthened hia book ])cdagogicnlly by gwnler use of this specific ap- 
proach. The undcrclftssinnnj however, sliould find the text readable, 
stimulating to insights, and socially progressive. 

Fred McKinney 

VnmrsHu of Missouri 

Bowlcy^ Agatha 11. Guiding the normal chiliL Now York: Philoaophical 

Library, 1043. Pp. xv + 174. S3.00. 

This book whioli is adclrossod to i)arentH, tuaohorH, sooiai Wdvkcr.s, and 
physicians coiitniiis many jnactical Huggestiona for dealing with behavior 
and adjustment problems of children. Its iuiLIku’, who is a iocturcr in 
the teachers’ training college at Dundee, Seolliiiid, has Imd wide experi- 
ence with nursery schools and as a psychologist in the Dundee Child 
Guidance Clinic. 

Beginning with an account of the cliild’s <leveloi)incnt during infancy, 
the treatment carries forward to the end of the iidoleseonb period. The 
Bpccific chapter titles are Infancy, The Pre-Scliool Period, DifFicuUics 
During the Pre-School Period, The Middle Yeans of Childhood, Diflicul- 
ties During the Middle Years ol Clrildhood, Adolescence — Dcvelopmcnb 
and DilTicultics, and Children and the War, 

The volume ia oxceptionally easy reading and contains nunioroiiB short 
case studies whiQl\ adds to its interest, It is decidedly not a typical 
textbook on child p.sychology, and probably should not be used for this 
purpose. It would, however, provide excellent supplementary reading in 
connection with a course in child psychology. It is distiuctly a “how” 
book. 

For the moat part the suggestions it gives for cliikl guidance appear to 
be based upon a sound psycliology of learning and adjustment. Oc- 
casionally, however, the author propounds a theory or takes a ]JOsifcion 
which seems at variance with the best current thought in America. For 
example, in discussing fears of the pre-acliool child, she says: “Thc.se fears 
are largely the result of unconacioug feelings of Ijadness, and may be 
termed ajixieties. . . . He may fear that hi.s parents may desert or harm 
or starve him if he is unworthy and unlovable l)ecauso he sometimes har- 
bours bad, hateful feelings towards them. If ho feels so to them they 
may reciprocate and retaliate. . , . This would seem to be at the root of 
the phobias of the pre-school cliikl which are so very common. Dknir.s of 
dogs, cats and spiders, for instance, frequently rci)r(‘.scnL a inojcciion of 
those unconscious fonrg on to some object in the external world ngainat 
which he may enlist protection” (p. 63). In other words, the child may 
be afraid of dog.g or cats not because of previous unpleasant experiences 
with them, but because he has an unconscious fear of his parents. With 
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respect to the development of intellectual traits, the author has a strong 
hereditarian bias. She says: “The dull child is dull by virtue of his poor 
mental inheritance. It is important to recognize his degree of dullness, 
to assess his mental age and so plan a curriculum that suits him and en- 
sures that his needs are satisfied” (p. 92). In view of recent findings 
with regard to the constancy of the IQ, this seems to be a rather strong 
statement. Her definition of adolescence as being “that period between 
13 and 18 years for boys, and 12 and 16 years for girls” (p. 131) would not 
generally be accepted as valid in this country. Our boys and girls seldom 
achieve social maturity or become weaned from their families at such 
early ages. 

Despite these minor criticisms, the book has very much to commend 
it. It is functional, and highly suggestive with respect to child guidance 
procedures. The chapter on Children and the W ar is particularly timely 
and valuable. Dr. Bowley’s book can be read with profit by anyone who 
desires a straightforward, simple, and dynamic explanation of child 
behavior problems and methods of dealing with them. 

Glenn Myers Dlair 


University oj Illinois 



New Books, Monographs, and Pamphlets 

Books, inoMgtdphB, atwl pomphlota for Uating ind possible review should be scut to 
Donald G. Paterson, Editor, Department of Psyeliology, University 
of Minnesota, Minneapolis 14, Minnesota 

Studies 0 / teachers’ classroom personalities, 1. Dominaim and socially 
inCiffralive behavior of kifiderdartea teachers. Harold H. Anderson and 
Helen M, Brewer. Stanford University; Stanford University Press, 
1946, Pp. 157. $3.00. Applied Psychology Monograph No. 6. 

The ennehmeni of life. Paul N. Elbin. New York: 17: Asaociation 

. Press, 1945. Pp. 87. SI.50. 

jSelsctioJt of students for vocational training. Pred M. Powler- Washing- 
ton: Goveroment Printing Office, 1945, Pp- 150. U. S. Office of 
Education, Vocational Division Bulletin No, 232. 

P/iTOU(|lt a dean’s open door. A guide for students, parents, and counselors. 
Herbert E. Hawkes and Ann L. Hose HawkeS. New York ; McGraw- 
Hill Book Co., Inc,, 1945. Pp. 247. 32-50. 

Principles of guidance. Arthur J. Jones. New York 18: McGraw-Hill 
Book Co., Inc., 1945 (Third Edition). Pp. 582. $3.50. 

Price control and business. George Katona, Bloomington; The Princi- 
pia Press, Inc., 1945. Pp. 246. $3.00, Cowles Commiasion Mono- 
graph No. 9. 

Diagnostic psychological testing. David Rapaporfc. Chicago 4; The 
Year Book Publishers, 1945, Volumjes I and II $6.50 each, postpaid; 
set $12,00, postpaid. 

The dice of dediny. An introduction to human heredity and racial varia- 
tion. David C. Rife. Columbus, Ohio: Long’s College Book Store, 
1945. Pp. 163. $1,75. 

Human nature in the making. Max Schoen. New York 3: D. Van 
Nosfcrand Co., Inc., 1946. $2,50. 

Pionesrs of tomorrow), A call to American youth. Hnna Weil. New York 
17; A8.sociation Press, 1946, Pp, 81. $1.25. 

Frontier thinking in guidance; An anthology of significant thought in the 
field of guidance. Edited by John R, Yale. Chicago 4: Science 
Eesearch Aaaociates, 1945. Pp. 160. $2.00. 

Practical handbook for coimselors. Developed by New York State 
Counselors Association. Chicago: Science Research Associates, 1945. 
Pd. IQO. Sl.SO. 
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testing. The second problem is a matter for mere arbitrary 
agreement among qualified psychologists, If it is agreed that 
in the total intelligence score the attention test is to have a 
value of one third or some other value, well and good, But in 
the end we will have an agreed-upon series of tests measuring 
an agreed-upon ability or group of abilities. 

One may well pause to wonder whether the term "intelli- 
gence’' as it is now (apparently) used is of any value to psychol- 
ogy. At present one's inteUigenco is merely a relative ranking 
on a battery of tests of the higher central processes. As such it 
represents a summation of the scores made upon the various 
component testa in the system. At best it is a sort of abstrac- 
tion or "average" intellectual level. A psychograph, repre- 
senting an individual’s levels on the various tests, would be much 
more elucidating than an intelligence score which merely hides 
relative strength and weakness in the component abilities. 

VAEIOTIS "kinds" OF INtELLIOENGES 

Again taking their cue from sociology and practical life some 
psychologists have suggested and introduced various "kinds" 
of intelligence. Thorndike has advocated these various species 
of intelligence as a logical outcome of his view that intelligence 
is but a bundle of specific and independent capacities. But it 
appears merely to add more confusion to an already sufficient 
confusion. If wc speak of absti’act, concrete, manual, and social 
intelligence then by virtue of the fact that we use intelligence 
throughout it is suggested that there is an intelligence common 
to all forms of activity. The thing then works very nicely 
over into Spearman’s common factor view. Would it not 
clarify matters if we spoke of just one kind of intelligence, 
possessed in different degrees by different people, and proceed 
to define intelligence in agreed-upon psychological processes? 
It would not be necessary to know the ultimate nature of 
intelligence, 
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EFFICIENCT RIGHT NOW VKUSU.S "CAI'ACITV" 

Any test mensurca what the subject can do right now, just 
fis he is at this moment and under the external circuinsfcancea 
which are present. Wc may call this ofUcicncy.'’ 

Eut is it ncccssavily the man's "capnoity?” Ca])acity should 
mean just wlint the term iinplie.*), namely, the person's ability 
under the optimum conditions for that orgnnisin. Capacity 
is apparently being used in two dilTcrcnfc bcurcs, one of which 
should ho entirely dropped or else very clearly defined. A 
person’s true capacity could be inoa-sured only wlicn that capac- 
ity haa reached its maximuiu maturation and practice. Tlie 
intensity of effort and interest must be maximal, to say nothing 
of the many other favorable external and internal conditions 
Avliieh would bo pre-supposctl, Ciipacity is, at liest, an in- 
ferred thing and its inference is fraught with much chance for 
unfairness. 

Perhaps it would be well to speak of measuring one's “cfil- 
ciency" when we arc seeking a person's deinoiistruble capacity 
as it reveals itself at the time of the testing. The tenn "cfh- 
ciency” would then mean merely what the subject was able to do 
at that time. It would have no implications beyond this. 
The term "capacity ” could then be used to signify what the 
person miffht do it his training, attitude, and physical condition, 
were most fam-able for the most complete development of the 
given capacity or ability. A child reveals au intelligence 
quotient of, any, 100 on the Stanford Binet testa. Later on 
by systematic physical treatment, good food, or training the 
intelligence quotient has been raised to 135, ‘ We may well say 
that the test did not got at capacity but merely efficiency at the 
time. To what extent we may infer capacity from efficiency, 
in the case of any test whatsoever, can be determined only by 
careful study. 

' Just such B casB Ims beoii rcccutly reported l>y Juno E. Dowuoy, 
.Fournnl of Applied Psychology, Vol. XI, 1927, page 52. Other uucU easea 
have come to the writer's attention, 



A STUDY OF THE RELIABILITY OF MENTAL TESTS AS USED 
IN OKLAHOMA CITY 

C, L. Cushman 
Oklahoma City Public Schools 

This study is given as a contribution to the available information 
coTictrning the teliability of montal testa when given by claaa room 
icnchcre. 

In the Oklahoma City Bchools it hna been the policy for the past four 
years to give each child entering the kindergarten or first grade a Bind 
Inlelllgence Teat. These testa arc given at about the time of entering 
the first grade. The plan in Oklahoma City has been to train all of the 
primary toacherB in the giving of individual teats and to have each 
teacher responsible for testing tho pupils of her own room. In the in- 
termediate grades pupila are retested with the Otis Self-Administering 
Teat of Mental Ability. 

For ft number of years the permanent record enrda in the schools were 
not forwarded from school to school with the transfer of children but 
each school made out a new card for every entering child rcgardleag of 
where he Inst attended. The data for this study were aasembled from 
these duplicate permanent record cards which arc now in the files of tho 
Research Office. 

The time intervening between the two teats ranged from one month 
to more than two years with an average interval of between eleven and 
twelve months. 

It is true, of course, that in certain respects the children represented 
in this study are not a typical group, That is, they are drawn from tho 
transient element of the city^s population. The fact that the average 
IQ., derived from the 352 Binct testa, included in these figures was 
100.3 and the average of the 1C8 IQ. 'a derived from the Otis tesba was 
0C.4 would seem to indicate that the group was not an inferior one. It ia 
entirely possible, however, that other factors enter in to make mental 
testa loss reliable with this type of children. 

Talile 1 gives the main facts relative to the reliability of the tests as 
shown by this flt\idy. An examination of this table will show that as 
uBcd in Oklahoma City the Binet and Otis tests are equally reliable. 

Table 2 is built to show the tendencies of the IQ, within the different 
portions of the total di.'jtribiition. In this table only tho Einet tests are 
considered. This table shows clearly two things) first, the reliability 

fi09 
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of the test TeaiiUs iuciMaaoH nvnidly iis the scoreH ftmiroftfU tlio mean of 
the distribution; soeond, where iininiliid lest gives nii K^, grcnlor than 
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diatftiice l)y which aiicliflcoi-os uro probably too high or too lowinoreagea 
with every inorcaae in distance from the mean. It will be noted that in 
api to of tlio ainnll number of ensoa in aomo of the outside colvwnns there is 
no exception in thia tendency to logreas toward the mean anywhere in 
tho table. 

An examination of the two tebloB would aeem to indicate that with a 
testing program organized aucli ns Oklahoma City's little importance 
should be placed on the mental scores of tho extremes of the diatribution, 
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THE AVILLr TEMPERAMENT OF INDIANS* 

THOMAS R. GARTH 
Unii'crsU]/ «/ l^cjivcr 

AND 

MAM A, IIAIINAUD 
Colorado Piyckopiilhic Jlospilul 

In these modem days the tcmi racial twnpovament has a 
very well established usage. We seem to see in tlic Chinaman 
one sort of tcmperaincnb, in the Negro another and in the In- 
dian another to say nothing of Italian tompcrainent and Irish 
nature. It would bo hard to shake the faith of lattorday mem- 
bers of society in civilization away from such n belief. Some- 
how wo have come to think just in this way aiid we Imvo not 
asked ourselves the question if thc-se temperaments are after all 
really racial, tliat is, native and not acquired. It is time that 
psychology were seeking to answer Iho question as to whether 
or not there arc such things as racial teinpcrainenta. 

Efforts have been made to study the temperament of the 
southern Negro scientifically (1), (2) and the device used for 
the purpose was either altogether or in part the Will-Tcinpera- 
ment Test devised by Dr. Downey. The results of these studies, 
one by McFadden and Dashicll in North Carolina and the other 
by Sunne in New Orleans are indicative but not conclusive. 

The writers recognize the inadequacy of all tests of personality 
used so far in making studies. This would inchulc of course 
the group test devised by Dr, Downey which we arc using to 
study Indian personality but we believe, with others, that it is 
the most promising attack of temperament yet made and that 
it bids fair to have a wide application as it is more mid more 
perleetcd. 

* PApar rend before .^ecLioit II, Amencaii AsHociiilioii for Ailvenco- 
ment of Science, December 2ft, 1020, at Pliiladelphiii, Pa. 

S12 



WlLL-TEMPliJnAMBNT OF INDIANS 


513 


PROBLEM 


The problem here is: 

1, To obtain, if possible, reliable measures of full-blood In- 
dians for the various tests of the Group Will-Temperament Test. 


TABLE ( 

Scores Olilahied in Orouj) \V ill-Tempermnejil Teel hj tOi and 

170 Full-Blood Indiana 
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For fulbWood Indian sobjecta 
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60% 
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* For cent of fuU-blood Indiana attaining and exceeding the median 
of the Whites. 

(A) Spend of Movement; (B) Freedom from Load; (C) Flexibility; 
(D) Speed of Deeiaion; (E) Motor Impulsion; (P) Self-Confidenee; 
(G) Non-Compliniice; (H) Finality of Judgment; (I) Motor Inhibition; 
(J) Intereat in Detail;, (K) Coordination of Impulaea; (L) Volitional 
Perseveration. 

2. To coraparn these with similar measures of white individ- 
uals so ns to asceiiniu if the groups behave differently when so 
tested. 
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aUUJECTH 

TIictc were two groups of subjects. One was a gi-oup of 101 
White students in a High School of Die City Schools of Denver. 
All but 5 of these were from the eleventh and trvcUtli grades and 
all but 7 were from seventeen years and on in aRC. Of these 7, 
ope was fifteen years and the otherH sixteen ycar.s old. The 


I 

A. Speed of Jlovcinoni Vl-l 

B. FTccdom ^roml^ad VI-t» 2, 

C. riGxIbllity \ni 

D. apcticl of Declilon I 

D, Motor Impulajon X 

F , BcW-cfJTifidoitcD XI. 

G, Non^complinncoXIL.,., 

11. PjnnlUyofJuclgmonlXin 

J. Muiorlnliibltlpn Vn 

J. Inlcrcalln DoLal) IX. 

K » CoUrd InHbrk ol IiupMl&Ca V 

L. Volition nl Porflovcrntloji VIII-2. , , , 


0! 23-15 eiosio 



23^S flTfl9lO 


J iVliilca; o-o-^, Indiana, 

Fid. 1. SiiowiNQ WiriTB AND Indian Gholi' Piiofjlns 

sexes wei'e about equally divided there being 49 girls and 52 
boya. The Indian group was composed of 170 full-blood In- 
diana from the United States Inclion Schools at Santa Fe and 
Albuquerque, New Mexico, and Rapid City, South Dakota. 
There were 85 boys and 85 girls. About half of the group were 
full-bloods from sedentary tribes being nearly altogether Pueblo 
Indians; the other half were from different nomadic tribes, 
mostly Navajos, Apachca and Sioux. 
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AdministTatioTi- and scoring 

The accepted technique of admiiiiBtTation of the group test 
woa followed as closely oa possible although it ia realized that 
the technique ia very difficult of execution. There was much 
practice by the experimentoTS in adminiatering the teat before 
the teats were given from which the data in table 1 were ob- 
tained. In scoring the teats the writere had some valuable 
assistance from the author of the tests for which they make 
acknowledgment. Regardless of these aafeguarda it ia felt 
that variations found in these results may be partly due to 
variations in technique and scoring, 

HANDLING THE DATA 

In table 1 will be found the Medians and Quartiles of the 101 
'White subjects and of the 170 full-blood Indian subjects for 
each of the separate test items and for the total score. There 
will bo found also measures of overlapping of the Indian meas- 
ures on the white medians. Figure 1 gives the group profiles of 
the two racial groups. 


INTERPKETATION 

In the first place it will be seen from examining the medians 
of both racial gioups and the profiles that there are points of 
similarity ns well ns difference; this is true on a basis of mere 
medians. But it will be noted that in some of the tests in both 
racial groups there is high variability and that therefore such 
medians arc somewhat unreliable. This is true in eight of the 
tests for the white group and six of the tests for the Indians. 

If one takes into consideration the overlapping of the Indians 
on white medians it will be found that the racial differences 
indicated by the medians in tests for Speed of Movement, Speed 
of Decision, Motor Inhibition, Coordination of Impulses and 
Volitional Perseveration indicate real differences as found be- 
tAveen the two racial groups. 

The overlapping for total score also indicates a tendency 
toward a real difference in that respect. That is to say, the 
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test indicates that the Whites avc aoniowliat more speedy tlum 
the full-blood Indians in so fiu as the teat indicates what it 
claims to test. They arc just tlie fifiinc in nexibility but much 
more inclined to make ([uiclc tlccision tfuin nre the Incliatis, In 
motor impulsion the two racial Biouiw are just (iliout the sanies 
but the Whites show a gveatev amount of wtf-eonlidoiiwc than do 
the Indians. In non-coinpliaiicc the results for tlie two groups 
are not very conclusive though the Whites arc slightly stronger 
than the Indians it would appear upon comparing mere iinsdiana. 
The same may he said of ftiuility of ju<lgineut although there ia 
more similarity in the two group measures and the results appear 
more trustworthy, i.e., both group.s appear rather strong in this 
respect. In motor inhibition the Indians certainly have the 
better of the Whiles though they are sliglitly more variable, 
In fact the test indicates that this is n rather strong trait in the 
Indian group and the weakc.st trait for the Wliitc.s. In infcoresfc 
in detail the racial groups are again rather similar tliough 
the Whites nro 1cb,5 variable. Tlicre ia a striking weakne.sa in 
codvdination of impulRca in the Indiana na here lucaHurcd. In. 
this respect the Whites arc (according to the autlior of the tc.sts) 
just about normal, The dilTcrenco Hccms to be genuine as 
measured, On the other hand the Indians attain a very high 
score in volitional perseveration and the variability is excessive 
under the civcumstanocs wherena the score of the Wlntca is 
much lower and their variability ia high. If we may take the 
total score aa indicating strength of personality the Whites 
would appear to have stronger personalities than the Indians. 

COMl’AUiaON WITH NEauoiis 

Unfortunately the tests given to these Indians were not the 
same as those given by the investigators mentioned above but 
we may make a rough comparison. MacFaddon and Dn.sbiell 
conclude that the Negroes tested by them were slower than 
their White group and in this luspect the findings for the Iiidiana 
arc similar in that they arc slower than the Whites, They also 
found the Negroes to be quicker in the matter of speed of tic- 
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davon than the Whites and we find the Indians slowev than 
Whites. These investigators found the Negvoeamore self-confi- 
dent but we find the Indians less so than the Whites, The 
Negroes were stronger in motor impulsion than Whites but the 
Indians nxe here fmmd to he similar oa measured. The Indians 
anti Negroes seem to be slightly similar in being weak in non- 
cornplinnco ns compared with Whites. The Negroes arc 
weaker in motor inhibition than the White group with which 
they were oom pared but here the Indiana excel the Whites. 
Doth the Ncgi'Oca and these Indians proved weaker in cotirdina- 
tion of impulses than the white groups with which they were 
compared and in volitional perseveration the Indians excel 
Whites whilo the Negroes fall below them in thia respect. 

The last finding of excellence in volitional perservation ia 
supported by a finding by Garth (4) in hia study of White and 
Indian and Negro work curves where the Indians held out better 
in a continuous task in addition than either Whites or Negi’oes 
although the Indians were nomadic Indians. His findings for 
Bcdontaiy Indiana showed them as not excelling in the work 
curve test (5). 


SUMlIAllY 

Wheji Indians arc tested with the Group Will-Temperament 
Test and tho i'c.sults are compared with results from testing 
Whites of aimilar age we find: 

1, The coinparLson of the total score indicates that Whites 
po.H.sesH .stronger ])crsonalities than Indians as hero measured. 

2. While the measures of various traits in both racial groups 
show great variability those showing least variability are: For 
Indiana, Speed of Movemout, Flexibility, Speed of Decision, 
Motor Impulsion, CrKiidiiiation of Inipulses, and Volitional 
reTsevorntion ; for White.s, Flexibility, Motor Impulsion, Motor 
Inhibition, and Interest in Detail. 

'J'he greatest (lifi’erencos between the two racial groups as 
imlieivii'd by im-iisurc's of overlapping are to be found in Speed 
of Movi'ineiit, Speed of Dc'i’ision, Self-confidcneo, Coordination 
of Impulses, Volitional rer.severntion and Motor Inhibition. 
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L Intcrpietcd Uw above nicaoa that llie Whites are more 
speedy in the teat than arc the Indinns, they arc quicker in 
inakiag deciaioiia, they are rnthcr more flclf-conlidcnt, they 
have lcs3 motor inliibition, better coordination of impulacg and 
arc poorer in volitional pereeveration. 

5. The greatest cliflfcreucea as fouiul hero hetryecn the rncea 
arc in speed of movement, speed of decision, coordination of 
impulses and pcrBCVcration. In only the last of these docs the 
Indian excel 

6. It is rather dangerous to venture any conclusion with 
reference to comparison of Negio and Indian Toinperament 
but it would appear that Indians are leas speedy in decision 
than are the Negroes and they appear to bo move given to motor 
inhibition than the Negroes. 
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THE FOUllTH INTERNATIONAL CONGRESS OF 
PSYCHOTECHNIQUB 

PORTIA HOLMAN 

Ojficiul InlerprclcT and Amslanl ta Dr. Lahy 

Rctwcon the 10th and 14th of October, 1927, the fourth 
International Conference of Psychotechnique wag held at the 
Institute of Intellectual Cooperation of the League of Nations 
in Faria, This society wna founded in 1920 by Professor Cla- 
parCdc (Geneva) with the niin of uniting at conferences and by 
other means all those whose work and interests are in 
paychotechnique. 

Its conditions of membership are very elastic. There arc no 
fees and no articles to subscribe to; its chief purpose being to 
unite a.g jnany paycholeclmiciana as possible so as to be truly 
international and representative. 

The Paris Conference \vn« the first since 1922 and by the gi-eat 
increase in attendance as in other ways reflected the development 
that hag lalcoii place in this science in the last five years. 

The wishe.g of ita founders that a largo body of aciontista 
representative of a large numbor of nationalities should be 
brought together were fully realised. In particular it was the 
first time delegates from the United States of America or from 
the United Soviet Itcpuhlic of Russia hod been present. Con- 
sequently it wins the firat meeting which can be considered as 
truly ropresciitativoof the trend of psychotechnical development 
in all pavta of the world. 

If that trend may really he judged by the views of the repre- 
sentatives at this ftonfcreucc, the meeting had a special signifi- 
cance in marking the stage at which the science of psychotech- 
niiiuo hug now arrived. 

Ah Mr. Lahy oxpr(!s.s('d it in hi.s report the conference appeared 
as a “piiljli(5 and iiileriuilional examiaalion of conscience," 
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This impovtcint mcetiug seems to Imvo heeu in ticcord with a 
general desire on the part of psychotcchnievaiiw in all covintiics 
to get into closer touch witli one anollier, to fuid out more clenvly 
what is going on elsewhere iiiul to create Inirinonious cooperation 
between the roscarcheg and investigations of din’erent. countrieg. 

There was a very general feeling that llie n?lativ(! isoliition of 
psychotechnicians in any one eonnti’y and their ignornnee of 
what was taking place elsewhere liad led to loo great a imillipli- 
cation of effort in the same field and a loss of valuable compaii- 
sons because in difl’orent places investigatots luul worked on the 
Bflmc material by similar but not strictly identical incLluulg. 
Nevertheless one of the most striking conclusions to be drawn 
from the conference was that, uotwillistiinding the nlniost com- 
plete lack of cooperation in the past, workers in difl’eront conn- 
tries had arrived independently nt tlic siimc methods and Imt 
the same ideas as to the brond and general linos of the soionce. 

At the eonfcvcncB there was a definite nnily given by the uni- 
versal interest in general questions of method, control au( 
interpretation. No matter what topic was being cliscus.sc( 
almost invariably it was to this n.spcct of it that both the ptipcri 
read and the subsequent discus.sion were ilirectiMl. Indeed, tin 
whole question of method and of the iducc of nmth(*inaticH mu 
statistics in psycUotcchniquc had liccn given spCidal proiuiiionci 
in the program, From this diRcu.ssion two outstanding problem 
arose: (1) the use and reliability of the correlation cocificicnt 
(2) the question of the constancy of subjects, i.c,, the rolinbilit; 
of a single test ns the measure of the subject ’s capacity, 

This second question which clearly affects the whole proccdur 
of psycliotechnical investigations aiousccl the demand for 
“gigantic international experiment" as one speaker well putil 
Among the discussions of particular subjects one might stres 
the question of teats of character na bcingof aiiccial interest to th 
conference. There was a general ogi’cemont that for pui'ijosc 
of vocational guidance and .selection existing tests are far froi 
jwlequQte. It was felt to be most urgent tliat attention should 1 j 
directed to the problem of suppleincnting them both by those ( 
moral qualities and by tc.sts of llie higher uumtal qualities, ft 
example, organizing aliility. 
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Tlio hoadinRs uiuU'r wliioh dirtciission look plixiM' ww; Prin- 
ciples atul Melliod of PsyclioleclinitiiK*, Tlie iMlueiilHlity and 
Coiifitniiey of Sulijetds; d'lie (ieneral Quesliou nf 'IVsls, The 
Problems of 'ITainiliR (of sj)eeml skill), The Hel:ili(ni of P.S3n:ho- 
tccbiiuioc (o I'kUveation, 'I’lie Uelaliou nf T’syeh<>((>eliiik|ue (o 
Psychialvy, The Qiavslion of Seleelioii with .S])e(‘iiil Hefi'reitee to 
Ti'iins])()rt Services.' 

The one unaaiisfiieloiy fealnro of tlie eoiih'rem'e was its 
brevity. It is, of course, of the iinlure of a eoiirtaeuce ihiit it 
should Inst onl.y four or five day.s but i( n'a.s pnrlieularly re- 
grettable in tlii.s instance beeiuise the iiuiiiIkt of piipevs was 
exceptionally Inr^e. Tlie problems (irisinf!; ont of (bein luiRlit 
profitably have been di-sco.ssed for a year. 

Tlio number of iitipers was so Rreat tbat iiuiny will be com- 
nniiiicatcd for the first lime in tlie proeeediuRs of the eonfereiicc 
to be pulilishcd .shorlly, Of those wlikdi were read tiiiu> per- 
mitted the disciis.siou only of a small miinlier :uid freiiucnlly with 
a lime limit. 

]i)iffcrcinccs in IniiRnagea iiiul the laek of (imo for complete 
traiisliitioii.s proseiiled another oh.slae.le to exelmiiRt'.s of vii-ws, 
At least there was no laek of privnlo diseussion between the 
crowded .‘••e.ssioii.s and, as wo have noted above, in .spile of mate- 
rial clilficnltic.s Iho general trends of ideas were \"(!ry clearly 
manifested. 

Most of the members prestmt were in agreement with the 
views put forward liy Mr. Wilson (r,on(loii) in a special 
paper dealing with the orgniii/aition of the aswiciation. Tie 
argued that the assoeialion should be more than a mere 
agency for holding occn.sional conferences and tlial as far us 
possible continuous investigations of an iulernutional character 
should go on in the inevitably lengthy intervals between 
conferences. In particular the association might usefully 
perform the function of codifying and bringing together an 

1 The i)ii])ei's nu Lliia -subject were read at a Hiieeial inccLiiiR of tlio 
psycho to cliTiiciil lahoratory of tho .SoeietC do 'rriniHpiirtf) «ai (toiinmiii 
(Ic la JlCgiflii Piii-isionno in which mciiiherri were iihio to Mupiiloiiieab 
discussion hy an iuspecLion of tlio pmclici! in LIuh liilKuntory. 
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authoritative sialciiUMit of lh(' ^v()^k tliu(. was boin^^ done in 
each Hold ill ovary coiiiiiry so liiat ovon uilliouL 
collal)orsUio]i psyoliotc'cliiiioiMiis in (lilTon*iit conntrio.H iniglU be 
in a poHilioii to puisno the saino oiids by lb(‘ SMiiu* lOoanH. 

In vi(MY of tho Koiionil ap;rcom(‘nl llui( ji.M^'^olioloolmionl oxperb 
incut can in gonoml p;ivo v.alid n'-sulls only xvIhmi (hoy aro umh 
on very larRo iiiinil)0r8 of Hiihji^olH it was ur^od lluit all po.^^iihlo 
fiLc|xs should l>n takon lo facililato iho iniikinp; of stric.ll}' com- 
parablo inv(\stip;alioiis in dilToionl lulinralorio.s. 

It was ahn foil that ccM’taiii sulijoolrt nii|i»;lil host l>(‘ invo.sLiKatOfl 
by an intornational coniini.ssion. In rosp(nis(! lo ibis fciolinpr 
topics for discu^^skm by a miinl)or of coininission.s wore put 
forward and for tlioso on whicli the cojifoieMCO uKiood a presidont 
of the coinniission was cloctod, Tli(‘ ooiiforcMico dedo^ntod to 
Dach proaidonfc the task of choosiii}? tho cionnniFsioii'a poraonnol 
and that of dctcrininini; the inaiiiier in whioh it will worlc. 

The Commissions arcj as follows: 

1. Payohotcclmiciil J^tudy of Atcidciits. PrcffOMSOr Marbe (^ynrtz- 

iHll'g). 

2. The iiidiicm'c of llic Knviroiuaonfc on the WorktM-, Mr. M ilHon 

(rmlimti'inl I'iLtiKiie lloKOin'ch llnui'd, fioudoiij. 

Ik Study of ICdiKMibilily. Ib'uJcssoi' (.HiipaviVle (CUnuwivh 

4. The liifUieiu'c of the ICxortioii of tlic Worker uii Onl.pnt. Pkh 
fesuov Liimmnn (.Hevliii). 

r>. The Pnicticnl Measures to Lo Foj'ni a CUnnplelo CnlleC' 

tion of ICxifiLinp: Tests, with l) 0 H(jrip(ionrt of MelliodH und 
so ftir OhUdned. Processor Pifu'ou, i Paris j, 

6. An AUciiipt to Unify t|io Psychotcchiiidul Vodahulary, Madame 
liaumirtu'teu (Solcnrc, S\vibz(Miiuul). 

One or two important slops were taken witli i‘(‘gard to the 
organisation of the association itself. At a preliminary meeting 
before the oiFicial opening of the conference a tentative plan of 
fusion of the Association of International Confeionec^ of Psyclio- 
tcchniquG with the International AssociiiUon of Psychology and 
Psychotechnique wap put forward . This fusion was voted on in 
the opening session and it wRvS ftubsecpirntly decided that the 
body arising from the fusion aliould Ueueeforward ho known an 
the International Association of Psycho Loclinif|iic. 
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A genei’ftl "coniinittec of direction’’ of this association has 
been set up composed of not more than two representativea of 
each country.^ 

The Institute q[ IntoJkcLual Cooperation has placed rooms for 
tho Secretariat-General permanently at the disposal of the 
fljgflOoiatioiL 

Dr. Moeller of llip^a liaa I)cen asked to undertake the direction 
of an Infonnation Service, by which it is hoped to keep the 
General SecretarJaC /md through it inernbers of the association, 
in constant touch with devdopmenta in every country. 

The town of Utrecht haa invited the asBociation to hold its 
next jncctiDg there in September or October, 1928. This 
invitation was accepted by tho members of the Fourth Con- 
ference bub tho exact date wag not decided. 

Tile proGcedinga of tho conference are being published and 
members will be informed as soon as possible of tho price at 
which tho volume is available. 

COMlTlSDmiCCTEUll DIO L^ASSOCIATION DES CONEfiBENCES 
INTIOIINATIONALES DB PSYCHOTECHNIQUE 

Membre^ 

Bfliimgnrton-Triiincr, P, (Mme.), Doctcur eu philosophic, Solcuro 
(Suisflo). 

llinghflrn, Dircctotir de Personnel Hesearoh PiSd^^ration, president 
cic PAflfiociation amdricainc de peychologici appliqu^. New York. 
Chriatiaenfl, A. G. Dirocteur do I'OfRco intorconununal d'orjontation 
profGssionnQilQ do PagglomdrAtiou bruxelloise. 

Clapar^ide, Ed. Dr. rrofcaaour b, TUniverflitfi do Gen^vo. 

Corberi, Dr. Asilo de JVIontbcllo prfis Milan. 

Dccroly, 0, ProfeaBCur a PUniver^ltA do Bruxellea. 

Ferrari. ProfcHjgeur A I’lIniverBitfi de Bologne. 

Grnnbftum, A. A. Dr, Dooent de Paychologie I’Univeraitd d'Amster- 
dam, rddacteur do ‘TAdmiuistrativc Arbeid/* chof du laborafcoiro 
paychologiquo b In ciinique Valerinsplen. 

Jotoyko, J. {Mile.), ProftSBcur de phyBioIogie A i'UiiiversiU de Var- 
Bovicp prCHidonto de la Bocidtfi poloDaise de psycho technique. 
Pahy, J. M. Dirocteur clu laborfttoiro dc psycliologie Qppliqu<5e i 


*Tlio list of memberfl of thia committee ia appended. 
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I'Kcole pralirnio (lea Iliiiili'a lit Ti I'Jnstihit ^li? iiaycliolrjgio 

de rUnivftrHiti; dtf TariH. 

Lilimniin, 0. Din^clciir do rin.sLilnL dc r.-nyrlndn^io a|)])lif|ui'c A 
lUjrliii. 

MilcHj (1. n. Dirotdtuii'-adjfjinl A I’Jiodil.ul iiiiliniud flo p»y<'lK)l()^ic 
indiifttricdle (h fjOiuinwi. 

Mini, 1'L DirofLuiir do I'fJ/lioo d’orioriUif iiui li liar- 

COlOlKJ. 

Moodo. ProfoHW'iir h llCoolo lf)(?liiiiqiio iniin'i ifniio CliiirldLloiilnir^rj 
Divoolvnv de, riimt-iUUo d<i nsyrKoU'vluuquo uidualiirllo do Chjir- 
lottfrihui'K. 

Myorft, V\\. l)ircoU!ur ilu I'luslilnl uuliniiul dr Vi-yrlinlf^j^ir iiidiiH' 
triollo tri.ondri'H. 

Piiion, II, rvofcwwcjuraiil'idloKiMluVnuii'OOlii do PHycliolo^ics 

do rUniveiHiLu do IVi'in, Dirooluur du Ljil*nralt»in‘ fi(‘ I'.syoliido^io 
111 S()rl)r>iiii(i!, 

lloel.s, K. rrofoHf-’oiii* A riTnivcrsilr tlTtioclil . 

RosHoiiiiin, (5. Trofosnoir do inuiropuMmlumi'; Din-cloiir ilo Ui fdifiiinio 
[)i)ur iiiiLladics iiorvoiiKtiH oL do I'lioilihit iioiiii dcif^ifiuo h la loro 
IJjiivnr.sitr do M-ohoou. 

iSpiolriiiu, I. I’lofoKHCur, clioC cUi UdioniU’diro p«y^'linU*i*ludq\u' do 
riiiHlitut pour 111 proLooiioii dii truvail ii MdsriMi. 

WojciochoNV.ski, J. DiioHonv do I'lii.-itiUit VsyidioUM'lini(|iio 

do i'I»]c(d<^ dll lirLtimoiil id du Huhmmi doa rpiriivi'ji i),\vrli(di!('iii)i(|iu*?i 
do.si (dioirilrifi do for A Yanjuvio. 

Sccreliiiro frVrifnd, J. M. hiiliy. Vixvht. 

ijiinqn^a la iiraduiiifn amUrrmy,}, Dr. Toiilnuf^o, I'M. iiinlooiii 
cn chef diroctoiir do riiflpiUU Ueiiri Ugimsollo, <lii(H't(?ur do rinfititul 
dn p.Hychiatno ot de propliylujcio monhilo A ri*>f>lr doH lluuUit 
Ftudoa, PariH. 



NOTES AND NEWS 

The Foiirlli Intcriiutiomil Conference of the New Education Fellow- 
«lui) met, lit LiieiLriio August 3 to 15, 1027. The English Report of this 
World (Jonfcreuco is now ready. Under the general theme, ‘'The True 
Mc.'Uiiiif; of Frceclotn in l-lducntion” nre tlio sections: Psycholoeienl 
L’l'ecdoiii, Freedom throiigli Method, through Environment, through 
(Jo-EduciiLioii, through Creative Art and through International Under- 
standing. Among the siieakors present were Dr. A. .Adler, Prof, P, 
IJovet, Dr. 0, Dccroly, Mrs. Jl. En-sor, Dr. E. llotten. Dr. A. FeTiibifirc, 
Dr. Did Wfinzo, Dr, H. lliigg, Dr. Carlel on IVnshbiirnG, Dr. Lucy Wilson 
and .Sir Jagadis Dose. The price of this Engliah Report is CO cents. 
Agents in llie U. 8. A. — Liookshop for Boys and Girls, 270 Doylstuii 
Street, lloslon, Mass. 

On November 17-lS, 11)27, under tlie ftij.9pices of Porsoniiol Research 
Federation a eonferenee dealing with the luiinan factors in industry was 
held at the Hotel Pennsylviinift, New York City. The aim of this con- 
foreiire was to promote scientific investigations of the following; tiua- 
ec[)til)ility to AeeidcnLs and Accident Reduction, Measurement of 
JwL'iuler.sliip, IIjc Per.sojial Inlervicw; Its Teclinitiuc and Reliability in 
Fiirl-l’iudiiig, and the Discovery and Mcagureinent of Mechanicfl! 
Aliilities. At Llie morning .sessions there were papers and reports on 
inKcai’dlins liy mcinhers of the Federation. In the afternoons groups 
were formed for round-table disenasion on the topics given above. The 
clinirinmi of the four groups in the order given were Mr. Eugene J. Benge 
of the Pliiliulelpliia Rapid Trunnit Company; Dr. F. H. Allport, Syra- 
cuse University; iJr. Hriiec V. Moore, Pennsylvania State College, and 
Dr, M. y, Vitclea, University of Pcnnsylvnuia. Col. Walter V. Bing- 
ham, Director, Personnel Research Federation, who with Mrs. Bingham 
travLded in Euroiie this foil and attended the meetings of the Fourth 
Intei'uationnl Congress of Psycho tcehnique in October in Paris, will 
give a paper on Recent Developments in Industrial Psychology in 
Europe. 

Child Eabor Day ivill be observed for the twenty-trat year the last 
wci?k in .Jiuuiiiry, 102S. To make known the facts concerning child labor 
and III stir the puldic to demand their correction is the purpoae of Child 
r.alior l)ay-.JiinuuiT 28 for synagogues, January 29 for churches, and 
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Juttuiiry 30 for achoolri nnd oliilis. 'I'lie Nnlidnnl Child I.nlior Com- 
mittcc, 215 FdiirLh Avcimc, N. Y., will hgiiiI frcfi of clmrRc, lo tmyiritor- 
CBtwl parsonB or groups an nnalyHiH of tlii; law of llioir fitaUi mwl oUicr 
matcTio.! to aid in Ihc ohscrvancnof C'liitd T.nhor Dny. 

Lolfliid .Stanford University ftiiiiounix's tlmt Dr, UoIktI il. .‘^cnshorc, 
National lloscarcli Fellow in Ysyeliology, lias conHtnielcd a portable 
outfit for measuring Hcneori-rnutor eodrdiiiutinnH. Aoconling to I*rof. 
W. It. Miles this apparatus is to hn oalled tlio Stanford Motor Skilla 
Unit, It includea six tests which tnnko iiKO of the siune ineo.hanisrns in 
several different wnya. The intcgrnled Hcorcs ore all read from count- 
era. A motion pioturo film (10 minutes] lias been prepared showing the 
unit being demonstrated and used. 

"T/ie Clasaijicnlion of Pupils in Private Sc/woh." Tlio recent report 
of the Tcsulla of a roRcarch program comluclod by twonly-flix bcIiooIb of 
The Private School Teachers' Association of PJiilndcIpliin tlirows into 
sharp contrast the scholnstio standards of public sebuuls and Ihoso of 
private schoola. The report explains why the same sols of standarda 
cannot be used for both, and acts forth norms for aid in the proper classi- 
iicatioD of private school students. The sixteen Inhles included in tlio 
report provido norms and rnagos for the various grades in chronological 
ago, mental ngc and cducalional ago. The procedure in using llicm is 
described and examples furnished. Price 25 cents a copy. Ucciuosts 
ahouldbc addreaeod to U. G. Clothier, Chairman, Ilaverford, Pa. 

The International Library of PluloBOphy, Psychology and .Scicnlifio 
Methods hns made nrmngomcrits with Dr. Horace H, MiigliNh to bring 
out a ytudent'a Diclionary of Psychological Terms. It is planned to 
treat from 2000 to 4fXX) Icrraa, including partioutarly tliosn whicli stu- 
denta are apt to meet as soon as they rend beyond elementary textbooks. 
The workia designed as a defining dictionary, syalcmalically recording 
actual usago rather than attempting to Icgislato. The compiler will be 
very grateful for any suggestiona rcceivod by the middle of February 
nnd addressed to him at Antioch College, Yellow .Springs, Oliio. 
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A. Mvkjihon, M.D. The Phijckology of Mental Disorders. Macmillan 
(JoRirmny, 1!)27, 1,'JJi jip, 

Tliia little hook in Bomcwlmt iniB-titled, ns the point of view of tk 
niithoT is tlirmiftlioiit iivowcdly that of the psychiatrist and not of the 
psychologist, 

Tlio honk is written in a style easily comprchansible to the layman, 
Indeed, it is for the Iftyinan tlmt the book is intended. Myerson de- 
Bctihcs various ones of tho ordinary mental disorders, telling aomething 
of the iitulcrlyinK causes so far as they are known, and auggeate what 
flljould he the social attitudo in regard to the psyahiatric patient. His 
whole diseussiou aectns to bo omincsntly anno and practical, 

Whilo ndmitting that psychiatry may be of great aid in aolving the 
problem of crime, ho insists that paychiatry cannot do it alUnd that the 
proldcm is mainly n social one and not one for the physician. 

Tho hook is well worth the rending. 

Eou’a rci) AwjJRKU fl liiNConN . Sez Di^crences in the Gromlh of Anierican 
School Children. Warwick and York, Inc., 1D27. 109 pp, 

In this liltlo volume, Lincoln has gathered together and summarized 
practically all of the invoatigationa which have been mado on tho prob- 
lem of sex (liiTcronccs of school ehiidren. It is to bo noted that ha limits 
his discuKsion specifically to children of school age, and his fiDdiags can 
ho extended to uduUs only aa tentative projeotions. 

In general, Lincoln's results aro nogalive; that is, differences between 
the acxcfl fire not found or aro found in sueh slight dcgreeB that after 
taking into account the marked ovor-lapping, no adequate adjustment 
aa to BOX ie poHsiblo. The above atatomont does not apply to physical 
growth, in whicli respect girls are found to be in ganoral physically more 
mature in every way than boys of a corresponding age. But in intelli- 
gence, in school accompliahmout, and in variability no signifioant differ- 
cucca arc discovered, Tho problem of school adjustment fa then a 
problem of adapting to individual differences without roapeet to sc.x. 

D, Rtaucii. I?duc«/tojiat Psychology. Hovised Edition. Macniillan 
Company, 1027. 608 pp. 

To tho one who is already acquainted with Starch's carllor book, 
little more commeut concerning tho present volume is needed than to 
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Kay ihiit iL is wriUf'n fujiri wry tiwwh tli(‘ Miiiu* ■iit virw junl Ij'is 

lieciri 0)1 t.ho wluilo viM-y woll up hi Hah*. 'I’ hr niH; purl ini lur 

addition in a v(‘i'y brn^f tliupti'r nn Moiilal JlyKirrP', a i‘haj»h‘r wlihdi \h 
prol)[d)ly t'H) bricd In hi‘ nf vny /;n‘at in Hie nf rrrriit 

dinrii.HsiniiH roiirn'iiiii^ iiinliiHd, nnuiy wuild liavr lil*ril to mm* (.ho suh^ 
jac.t troiiLnd a iimn; hnnidly. ■Shncdi'iinwii hcliri' in ( jir 
of lh (5 diHOUHsioii, hnwr-N’orp is of rn^nsr w an uni tuwuid biM iirplrrt of it. 
Most of tlin m’Otil. invrfdi^Mtlinns of ii(»(rili I‘]dtn‘a( iniial ruyrliril(ijj;y 
|]av (3 found liu'ir way info Urn hook. ■'L’lm invirwi'r findi^ t liiil I hr Vfiliirna 
would of unwu pnw'.lu'id vidnr, i( snsnr viC U\r ^'‘fundavd 

iiHod in Min iiivoMl iKalionH ndat iii^; hi hoIkkiI snlijnH ‘i wiMrnf inon* rni'Oiit 
Halo. Jn iniiiiy iiiKlancns rcfnrcnceH urn mudn hi M'lvfs wlii'di Iiiivn lon^ 
sinctt \^w^\ rtup plant lid. U ui of nmiiHi* a slupnuHinni hi^k to lu'cp up with 
all of tho new loHtw whiidi urn Indng rh'viM'd, and u Imok (d Lliis .sort 
should nob 1)0 oxiirfdud ovon In list all of llioni. Jlnwovi-r, I iin slaUunont 
that ‘'fni' inoaHuvniR Kominil inriil in wriUtoi (‘ompo^iilion /irn ,si*alo.4 
have licrii ooiiHLruclod” Kooins hardly up L)i diiln ( KiHiorj iniru'). 

Ah in tho earlier cnlitinn, a lar^o piojini'linii of (he h‘\-f, npprnxinialnly 
forty por ront^ in p;ivoii In the [j.Mycfliolrury |,f Hidnml snhjrrl.s, thus rediu’- 
iiij; the value of tlio hnnh for a (leparliiieiit in wliiidi usojiiiralc? enursn \n 
Riven on those lopieH. For u Rniieral nanso, linpevnr, (liin prolml)]y 
roproscnlH llui iio.it hnok avaihdilo. 

1 ). A, Winn j:sTi:i|^ 
h'nin'JViirv Iff yt hnii^bi, 

lllMAUii. lirhrri^ntthi 7'rdf/. 1 ii( rodiKH irn\ by (’ollifk.f, 

M.D. Miioiiiillun f’oinpiniy, Nmv York, ‘jn.’) pUROs. 

Mishi liillyoi'j Ilia sane, iiitelliRr>nt pei.MJii, is iddr hi .hi and anide fiinn 
lau’rtelf, JW it worn, and view ^finn Jfillynr, tin- pHyehopiifh, aliiinsl h.h 
cibjeidivoly as HiourIi hIio were viewing snineoni* idsiv I hit the .hiuk* 
MiKS Ilillyor remeinher.s so vividly many of (be mmilnl exprriinn'es of 
the iiisnnu ^sli.sHl\iUyer thatshi^ is idihi In rIvo Iho niadrr I in* .sub jeo live 
uH well i\H I lie uiijeelive view. Tins is a niLlii'i* nwlavanl way of suyiuir 
tlnibsliR i.'^ahlt? lo de.serilie (In? exp(‘i'ieiice of Rniii^ \viMinnl iiidul|r- 

iuR in Hidf-pily nr hystinies idaml hevsidf . Her arenuip includes inueb 
that thoscnouHKtndeiil. of menial piilholoRy would wish in know. iSoiiie- 
thing of her heredity, much of hov idiildliood and early iinnu* eiivirnn- 
ment, thu breakdown, her luispilal oxporieiwih hniR periods of oblivion, 
an iitteinpt iit Hnicide, returning inleresls and aclivilies, I lie relurri (n 
her own world whih? yet I nit proeariously bulaueed, and (he long hnprfiil 
struggle one infers, is still mduK on In reuuuii aormully heallhv 
minded. The wnlcr d is pi ays a Icccn iiiKight inlo (la* ciLir-es of iicr 
troiililn, and inoro pari iciiliu’ly Mm fufTni-.s enlrniig iiiln licr reshn uiion 
to inonta] heall li. 
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SliG bn-s a very iiniifliiiil and very iJifcore^ting story io tell. She fcella 
it simply, and with b touching restraint. Neither confesB^ 

ing nor lioBHlinK, she inoreiy Tclatca^ imd it ia in this objective viewpainb 
111 fit in\ich of llic value of the work lies. 

In Iii» iiitrodticfcioii Dr. ColHnti, bosidea aBSurmg the reader of hia 
Lclicf in tlie geiiuiiveucBH of Misa Ilillyev'H experience and disGuaaing 
Honic of Ihn walicnt points of lior cnacj presents the psychiafcriafc'a view 
0/ bow niciitnl abnornmlity «lu)uhl be regarded, 

Ajyiofl C, AndeuboNj 
Ohio Univeraii]/. 

E. JoiiDAN. The Life of M ind, Charles \V. Laiit & Company, Indlanap- 
olis, Ind., 1025, 324 pp. 

Jordiin’H '^Lifo of IhcMincr^ develops into little more than the au- 
thor’s own rather narrow pliilosophy of a nan-scientific life. The general 
trend of the book ia that belonging to an era that had been buried, 
Hiipposedly, for at lertsl n. decade. 

Although following topics that are closely aUied. to those found in 
any eleniontLiry textbook of psychology, the author disdains bo mention 
priie Lie ally all of the usual hypotheses except in a most derogatory ^vay, 
— not for nny cons true Live reason, but seemingly merely because he 
jH violently n[]posed to anything that may bo termed ^'ffcientific.^' In 
spile of bids slalod viewpoint wo find him turning to the ecienbifle dia- 
covorics of physiology and otlier sciences when an explanation of songa- 
tiona ia desired. 

The section devoted to auditory aonsationa is typical of the whole 
book- Noises and tones arc to bo diabingiuBhcd nob becauBo of different 
chai nclerisllcB of vibration rate, but merely from the asaumption that 
the htrrrrjtn hoirrg tones and *yis}c/cc5" noises. Because c! thiii 

noiso iiasocialion with the automobile, this happy vehicle is referred to 
by the author as a ^ 'spawn of the devil.” Could this bo a defenao mecha' 
nism? 

Duo bo its own atyle, and to its obscure birthplace, the book, fortu- 
iiaLcly, will have lULlo chance for n popular Ufo. Its cont-emporanea arc 
tliOHCJ tlmb aaw the light of day in the eighteenth century, tefore the 
advent of the laboratory. Moclorn psychology attempts to advance, 
instead of retard as this book glories in doing, accurate and verifiabLe 
cxjdnnalionB of human conduct or behavior. 

S. L. ClUWLEY, 
lndiane> Universihj. 

MniinoN K. Tiiomron. The Sprinffs of H^man Action. New York, 
Ih Appleton and Company, 1D27. 501 pp. 

All exh nil stive lilci'iiry analysis, of native and acquired "springa of 
Inimjin iicijon" written from the viewpoint of popular psychology. The 
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cxporiniGntfil aLproaoh in conspiciioiiaby itfl [il)scin!c. A l)ibUoKr[iphy of 
KoiiiQ 250 titlcfi \h uppeiidecl. 

CAHTi K. Spahhoub, Learning a-nd Living in CoUegc. Tltiivorflity of 
lo^va StikdioH (Hchcfl on Aiiiie luul TrogroAH of Uoifcarch), Volume 2, 
No. 1, 1027. 124 pp. 

A fiirnplo, HtruigUtforwnrd, noTi4aahiimnl proHoiiifllion of tiio out- 
comes of the niilhor^H work on Lhn SLiiclcnfc Project^' under the 

niispiccH of the Naiionnl Ilcseurch (kmimil^ during which lie viHited nvor 
100 American Gollcgeft. Tlio philosophy of tho hofik niny he Hiniimed up 
in the dictum 'Keep each child lmny ftt his hii^liesl iiuturn! level of 
successful ftchiovnmont and lie will be happyj uHnfiil and good." Modern 
mass eduention ia not iiccoHsnrily mil ngonistie to rcscogiutioii of the 
inclivLdiml. Individual capneity may heat he recognized, moLivated 
and iQwiu'ded throiigli aomo fourleeii pronedurea, wliieli, in the aiitlior'H 
opinion represent the eroatn of tho proccdiires noted by him:— a college 
qualifying GxaniinatioTi, dopurtincutnl plaocniout oxnmiimtionfl, sec- 
tioning on the \mm of ability, project toachhig, honoru Hyrilomfl, honors 
time credit for suponor work, elimination of competitive introductory 
courees in favor of busia cimrsGfl, ablest teacher loach iiig hiiaic course, 
vaiioiiB survey and orientation courBCH, inlcllectual comradeship of 
abler Htudentfl wiLli faculty, clmractor record and inntiviiLioii, perHonnel 
BcrvicD; jiiuior college, dilTorniitiation of functionH of iiiHtitutioiis— a 
majority of which apiiear in the hook as chapter lunidH* No where at 
the prcHcnt time will one find ho condenBed and ao readable an account 
of tho aims and pliilowophy of ho many of I ho newer ruovotiiontH in coU 
lego education. All who have an intorcat in higher education might 
well be urged to read it. 

llKuiiKirr A, Toors, 

O^iio Sidle Univemity, 

ICiMiiAij.. Youno. Source Hoak for »S*ociVd Psijcholcim, Now York, 
Alfred A. Knopf, 1027. 844 pp. 

This addition to the growing list of books on eocinl psychology will 
Bcrvc primarily thoBc readers who lack oasy nccesa to the litornturo since 
it contains excerpts from 220 aourcea. The author prcflcnts the subject 
matter of social psychology through tho avenue of the group rather 
than through the individual. In general, the plan followed ia, (1) a 
consideration of piG-liuman and human behavior as determined by Llie 
group; (2) an exposition of the bases of social behavior as revealed 
through physiological and payehologLoal Btiidies; and (15) Jiii examination 
of personality as it clovolopa in group relatioiiHliipa upon the triple 
foundation of social group, culture, and tho iiidividuah 

To aeliiovo tho above plan tho author di vidua the HcloctiouB under six 
main headings: gcnornUcaturcw of social behavior; pHyclmlogical founda- 
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tionfj of social lielmvior; ])crflonaUty and pocial behavior; sociiij nfcti- 
tiulcB aiul the Bii!)icclivo cTiviromnon t; Icndorehip and ptcabige in social 
l3clmvior; and coUccLivc behavior, Thorc arc 27 chapters; each with an 
introdvietory (UfiCiiHHion iiulicalinR ihc problems reviewed aad explain- 
ing the induHum of certam HulcntiouB. Queationa cmd ex&rcisca and a 
ficlcclod hibliogruphy follow at tlio end of each chapter. These intro- 
(luctory diftcniHwoiiH and class exercieea form an integral pan of the 
volume. 

Wiule \v(‘ arc infcinncct by the author that tiio compilation is seUclm 
aiul not n\hunHtiv(\ and denpitc the praiacwortliy attempt to organize 
tJie cxccrptH nndor six cfttcgorics of eociiil behavior^ one layfldowabhe 
vohimo witli a growing conviction that aocial paychoiogy is an 
flinorphouff flub/eGt; an affair of theory and little exporiment. Admit- 
ting that Lite subject ns it riowexista is not well-defined we mayrecognke 
that this flOnroo hook is truly repreaenlativo. Wefmdmit, for oxample, 
brief glcnningfl from the writings of anthropologists; neurologists, pro- 
fcHsorB of education, philoBophcrs; phyfliologisfce, political soientifita, 
psychologistH; BUciologiatfl, and a novelist; the greater number of selec- 
tions btiing nltribiilcd to the aociologists. Not more than 13 per cent 
of the avtielcft contain data derived from experiments and cbbc studies; 
or^ regarded Hoinewliat clifforcnbly, more than 86 per cent of the pages 
arc theoretical in nature, Undoubtedly the number of non-experb 
mental pupera written under tho title of aooial psychology is far greater 
than that representing the quanbitative or cxpetimental icporlsj but 
the oiiURHion from lliia book of many recent important experimental 
ftrliRlea detracls from its uecfulneeBj and contributes to itg chief weak- 
ness which is failure to exploit the newer psychological approach to the 
field, Nevortholcaa, Young'e '^Source Book/' ueeful to the general 
render, is a vnluablc rofercnco work which promises to supplement the 
content of courHOB in social psychology. 

CnAuLEa Bwd, 
Univeraily of Minnisoia, 

J. JJakeu. Charaaleristic Differences in Bright and Dull Children. 
Public School PublJflhing Company^ BloomingboH; lU.j 1927. 11& 
rP' _ ^ . 

Pefore iiitGlligence quotients and mental ages can have much bearing 
upon our acliool practices they muat be tmnBlated frotn figures into facts. 
These facts must bo stated in terms of aptitude for school work, attitude 
toward Htudy, methoda of learning, rate of progTCfiS, cto. This has 
boon done for the sulniurnml child in aevcral recent books, and to some 
extent has ])cen attempted for the gifted. The dull and the bright, 
lu)wever, liavc not received their due share of nttcntfoii. The author 
)i(iR wrilloii this little volume in an attempt to interpret the IQ's which 
lie IjcLwcch 70 and 00 and tlioeo between 110 and 130 in terras of school 
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work and procedure. Tlic lornicr Knmp he (lallH “dull” nrul the Utter 
'^jright/' and the book is concorned with eoiiLrasliiig ihoHO two groupa 
with respect to llioir naUircH and behavior in various srhool siluatioiiH, 

The material which lh the ImihU for llie hook was olitaiiieil by uskiiig 
fivo hundred Dfttmit toachura to report upon these two groups of dill- 
(Iren with respeot to ^'diffcTcnces as they expressed iUnin in psychologienl 
tcrmiiioloKy, upon dilTcrenccH i\fl cxpresHcd in their tueLliotln of teaching 
procednrcfl and in nny other wny they wished-” The iintlior tdifl ua 
that the report.^ were rernftrkfti)ly uiiiiriiinoiiH, l)Ut lie (hjen noL auinmn- 
rizG them except aa he roihsolH llujrn in the courHO of tli<o iH)ok. At least 
one reader ib disappointed in Retting i\o liettcr vUw of t\\e oviftinal data 
upon which the book in based. 

The opinion a ol five hundred toanherfl ought lo furnish an excellent 
bcglnningon tlio proldem set for this vuliiino, l)y providing indications 
of topics on wliicli rcacarcli might prove fruitful. Opiniciiia, however, 
ought not to ho conaklcrcd sufUcient for n Ircntiee on a aubjcct 

concerning which facta arc ohtaiiiahhi. Afl a conficcpioneo of uaing 
opinions instead of facta, the author has often been guilty of dogmatism. 
For this ho occftsionally cxprcwacs regret, but the fimlt lies fuiulamcin- 
tally with the citop of owing opinions ns facts, ami hooiuh iiuhffenaible to 
at lensD one reader. The luitlior luiw many opinions whicli are plauwible, 
Init obliGi's nro highly dubiouB and controversial. Tor o.sarnpio, in 
dealing with iho pvoblom of Hpccial nlnUticH uiul diHuUililies, wo arc 
asaureJ that a bright child ''hcldoin sufTcrw from a diHnlulit}',” while a 
dull child with a spccinl iliHahility haw a ‘‘Hcrious luuulicap.” On tlic 
otlior hand the coinbiimtioii of a bright child und n Hpecinl talent ^'fur- 
nishes excellent rcsultSi” but w|Hicial taleiiL in often a liability to the 
dull pupil.” It is doui)tful whethor bmoU xiuvcriried opiaious ought to 
appear \\\ the field of educational ULevaluro, CHpooially wl^en verification 
is possible. 

Part II of the book is dovotccl to the din’oroncos of the two types with 
rcapeot to their work in apecific school subjoctn. Here also wo liml a 
great deal of opinion and a very winnil cpiantity of fact. Wc aro told 
that in the fiocial studied that the dull child exhibits a narrow and sclfiwh 
point of view, while the bright child iu the oppoeilo. In nuifiie the dvfil 
child waits for others to got the pUcIi or to lead, while tlio l^right child 
has all the quaUtioB of a good musician. Pull pupils are ”iiiforjor in 
art;” while "work and study in art Imvo always been a natural gift of 
bright ffiindfl.” So throughout the book wo find many such HtaLeincnta, 
and most of them arc entirely unaupported hy cxpeCLiuoutiil evidence. 
It may well be true that a largo number of the opinions nre correct^ but 
it is Ofiiiaily probable that emne arc doubtful and olhore mislcadiug. 

Part III if! a brief clisciiBfliou of how clnflHCS aro ficcLioncd in Detroit, 
nufleoino commcntH on tlio LyiMjaof proecduroB which the author bcJievcB 
to bo nccosaary for each type of child. 
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JcffjA A. IviJiKWooii. The hcarninq Vroct^^ in Young Children. CJni- 
verHily of Iowil StudieB. fcitucliea in Child Welfare, rublished by 
the UiuverHily, Iowa City, 1020, 107 pp. 

This inormgrapii frivea an account of a atudy of the Learning procoaa 
in yming cUildron. It not only makes o. contribution to inlorination on 
how children learn, but also adda to the methodology of experimentation 
in thiK lioUl. T)ie varioua problcma abudied center around the fcaak of 
learning a iscrica of IwonLy ftssociations which the author haa cleverly 
(leviHcd. ThcRO conHifit of acHociationB between blocks and pictures 
which are not too difliculfc for children above Clirco years (or even aomc- 
whftt younger), inifc which are difficult onough eo that only ono of seven 
adultH of superior nacntalifcy mado a perfect score on the firafc attempt. 
The twenty nssoemtionfj wnro to be formed within twenty triale^ and 
the aaaociaiionH were declared to bo learned whcnovoi the subject could 
make three perfect performances in succcaaion. The author fully dem- 
onabratca that this criterion is much preferable to the more frequent one 
of a flinglo perfect porformnneo, or even two perfect performances. 
Turtliermorc she has shown that requiring more than three auccessive, 
perfect perrormanccs would be unnoceasary. The number of chridron 
tested was 2011, but for various roagonssuch aa absence, etc,, the number 
of records uaod in tlm report is only 180. Tlio precaution of the author 
in making the conditions of Learning standard and in rejecting aU cases 
which did iiol conform to these atandai^ds is highLy commendabLe^ 

A iminbcr of problems were studied; learning on flUCGCBaiye days 
versus learning on alLornato days; plnbeaua; rcloarning after an interval 
of II year; transfer and interforence of n set of learned asaociations with 
a second series of similar nsBociations; differences between children 
accustomed to psychological tests and those unaceiistomcd to such tests; 
correlnlioPH bebwcon bucccsb in learning tlicaa QBSociationg and success 
on VftriDUfliii tolHgcnoo and form board testa; and other points of interest. 
In all infltancca the data havo been collGcted and handled wi th precision 
and good judgment. The author Very wisely refrains from attempting 
to catabliBh norms for the various age groups, and from drawing infer- 
ences and coTicluBiona beyond thoao justified by the data. Among the 
things of particular Interest to the reviewer was the contrast between 
paired children, half of whom were learning on succeaBive days and half 
on altornatfl days. In spite of the immaiurity of the children the supe- 
riority of learning on alternate days wos clearly demonstrated for this 
material. Another point of interest was the fact that plateaus occurred 
more frequently among the leaa maturo children than among the older 
□ncB. 

The wholo study is inLcrosting and well worth the time of any indivld- 
iml intercHted in this field of experimental work. 

STCTAnT M. Stoke, 

Ohio University, 
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IJookH (iml iinTin)lilcls I^»r Tc\5(iw ftUimkl Ia'. siiiil lo ikmiia IV I'Drler, 
DcjiarLiTicnt of Psycliolony, Ohio lJnivoi'nily, A LIioiim, Olijo, 
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